At the bottom of the Update Status area of a contact record is where you see the various past activities or items related to that contact.  Clicking All will display them all going backward in time.  However, if you just want to see the notes you’ve recorded for them, click on the Notes button. This works for Email, Listings you’ve sent, and Calendar items as well.  This is called the Activity Stream, and you access activities with the buttons.