Studying mind perception in social robotics ımplicitly: the need for validation and norming

Abstract

The recent shift towards incorporating implicit measurements into the mind perception studies in social robotics has come along with its promises and challenges. The implicit tasks can go beyond the limited scope of the explicit tasks and increase the robustness of empirical investigations in human-robot interaction (HRI). However, designing valid and reliable implicit tasks requires norming and validating all stimuli to ensure no confounding factors interfere with the experimental manipulations. We conducted a lexical norming study to systematically explore the concepts suitable for an implicit task that measures mind perception induced by social robots. Two-hundred seventy-four participants rated an expanded and strictly selected list of forty mental capacities in two categories: Agency and Experience, and in two levels of capacities: High and Low. We used the partitioning around medoids algorithm as an objective way of revealing the clusters. We discussed the different clustering solutions in light of the previous findings. We consulted on frequency-based natural language processing (NLP) on the answers to the open-ended questions. The NLP analyses verified the significance of clear instructions and the presence of some common conceptualizations across dimensions. We proposed a systematic approach that encourages validation and norming studies, which will further improve the reliability and reproducibility of HRI studies.