I would like to suggest separating the right to add notes to user from editing users. I would like agents to be able to add notes for customers, however, not be allowed to edit customers.