Multimodal analysis of personality traits on videos of self-presentation and induced behavior
buir.contributor.author | Giritlioğlu, Dersu | |
buir.contributor.author | Mandira, Burak | |
buir.contributor.author | Yılmaz, Selim Fırat | |
buir.contributor.author | Akgür, Berhan Faruk | |
buir.contributor.author | Kınıklıoğlu, Merve | |
buir.contributor.author | Kurt, Aslı Gül | |
buir.contributor.author | Dibeklioğlu, Hamdi | |
buir.contributor.orcid | Giritlioğlu, Dersu|0000-0003-1503-0213 | |
buir.contributor.orcid | Mandira, Burak|0000-0001-9605-8642 | |
buir.contributor.orcid | Yılmaz, Selim Fırat|0000-0002-0486-7731 | |
buir.contributor.orcid | Akgür, Berhan Faruk|0000-0002-9390-1160 | |
buir.contributor.orcid | Kınıklıoğlu, Merve|0000-0002-6668-9168 | |
buir.contributor.orcid | Kurt, Aslı Gül|0000-0001-5222-8291 | |
buir.contributor.orcid | Dibeklioğlu, Hamdi|0000-0003-0851-7808 | |
dc.contributor.author | Giritlioğlu, Dersu | en_US |
dc.contributor.author | Mandira, Burak | en_US |
dc.contributor.author | Yılmaz, Selim Fırat | en_US |
dc.contributor.author | Ertenli, C. U. | en_US |
dc.contributor.author | Akgür, Berhan Faruk | en_US |
dc.contributor.author | Kınıklıoğlu, Merve | en_US |
dc.contributor.author | Kurt, Aslı Gül | en_US |
dc.contributor.author | Mutlu, E. | en_US |
dc.contributor.author | Dibeklioğlu, Hamdi | en_US |
dc.date.accessioned | 2021-03-08T12:21:52Z | |
dc.date.available | 2021-03-08T12:21:52Z | |
dc.date.issued | 2020 | |
dc.department | Department of Computer Engineering | en_US |
dc.department | Department of Electrical and Electronics Engineering | en_US |
dc.department | Interdisciplinary Program in Neuroscience (NEUROSCIENCE) | en_US |
dc.department | National Magnetic Resonance Research Center (UMRAM) | en_US |
dc.description.abstract | Personality analysis is an important area of research in several fields, including psychology, psychiatry, and neuroscience. With the recent dramatic improvements in machine learning, it has also become a popular research area in computer science. While the current computational methods are able to interpret behavioral cues (e.g., facial expressions, gesture, and voice) to estimate the level of (apparent) personality traits, accessible assessment tools are still substandard for practical use, not to mention the need for fast and accurate methods for such analyses. In this study, we present multimodal deep architectures to estimate the Big Five personality traits from (temporal) audio-visual cues and transcribed speech. Furthermore, for a detailed analysis of personality traits, we have collected a new audio-visual dataset, namely: Self-presentation and Induced Behavior Archive for Personality Analysis (SIAP). In contrast to the available datasets, SIAP introduces recordings of induced behavior in addition to self-presentation (speech) videos. With thorough experiments on SIAP and ChaLearn LAP First Impressions datasets, we systematically assess the reliability of different behavioral modalities and their combined use. Furthermore, we investigate the characteristics and discriminative power of induced behavior for personality analysis, showing that the induced behavior indeed includes signs of personality traits. | en_US |
dc.description.provenance | Submitted by Onur Emek (onur.emek@bilkent.edu.tr) on 2021-03-08T12:21:52Z No. of bitstreams: 1 Multimodal_analysis_of_personality_traits_on_videos_of_self-presentation_and_induced_behavior.pdf: 2895442 bytes, checksum: 2d3e5a16f9be858004020a4f06627a12 (MD5) | en |
dc.description.provenance | Made available in DSpace on 2021-03-08T12:21:52Z (GMT). No. of bitstreams: 1 Multimodal_analysis_of_personality_traits_on_videos_of_self-presentation_and_induced_behavior.pdf: 2895442 bytes, checksum: 2d3e5a16f9be858004020a4f06627a12 (MD5) Previous issue date: 2020 | en |
dc.identifier.doi | 10.1007/s12193-020-00347-7 | en_US |
dc.identifier.eissn | 1783-8738 | en_US |
dc.identifier.issn | 1783-7677 | en_US |
dc.identifier.uri | http://hdl.handle.net/11693/75892 | en_US |
dc.language.iso | English | en_US |
dc.publisher | Springer | en_US |
dc.relation.isversionof | https://dx.doi.org/10.1007/s12193-020-00347-7 | en_US |
dc.source.title | Journal on Multimodal User Interfaces | en_US |
dc.subject | Big five | en_US |
dc.subject | Estimation of personality traits | en_US |
dc.subject | Deep learning | en_US |
dc.subject | Multimodal fusion | en_US |
dc.subject | Self-presentation | en_US |
dc.subject | Induced behavior | en_US |
dc.title | Multimodal analysis of personality traits on videos of self-presentation and induced behavior | en_US |
dc.type | Article | en_US |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Multimodal_analysis_of_personality_traits_on_videos_of_self-presentation_and_induced_behavior.pdf
- Size:
- 2.76 MB
- Format:
- Adobe Portable Document Format
- Description:
License bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- license.txt
- Size:
- 1.71 KB
- Format:
- Item-specific license agreed upon to submission
- Description: