The history section contains all records created by users that show how the account has gone through your system including Notes, Documents, Phone Messages, Follow-Ups and Status Changes.
With contacts, you want to be sure to only save notes and documents that affect the contact. Do not put notes or documents that would affect a specific project into these sections. Users will not be looking in the history of a contact for anything related to a project.