We describe a peer to peer (p2p) system, which we call the MemoryNet, for sharing and annotating media objects among people in our personal networks. Recognizing that people naturally associate their own media with that of their friends, we developed a prototype (the MemoryNet Viewer) to investigate how these connections might be reflected in a software infrastructure. It was also a stepping stone to further research that looks at how people share stories and maintain an awareness of the lives of their family and friends. We present the results of a small study that tested the concept of the MemoryNet Viewer (MNV). We conclude with details of how this work is progressing based on our initial observations, and detail future research and deployments. 8 Pages