To re-assign contacts to other agents, follow these steps:
Open the contact
Click on Personal
Select a new Contact owner
Save
The new owner will have full access to update the contact. If the contact is shared with the office, other users with full access will be able to view it but not make changes. However, the office admin and creator (the agent who created the contact) will still have permission to update the contact.