In this study, we propose a system for organizing personal photo collections. Motivated with the fact that people related queries are the most desired ones, we propose a method for labeling faces in photographs. After representing the detected faces based on the descriptors extracted around facial features, the similarities between all faces in the dataset are found. When user provides labels for a few set of faces, these labels are carried out to other faces using the automatic labeling process. For this pur pose, we proposed a method based on the confidence decisions of three different methods. The user is allowed to provide feedback to increase the performance. Roth search and browsing mechanisms are provided to the user to get the pictures of single or multiple people. © 2013 IEEE.