Human Perception of Emotional Responses to Changes in Auditory Attributes of Humanoid Agents

Zhao Zou, Fady Alnajjar, Michael Lwin, Abdullah Al Mahmud, Muhammed Swavaf, Aila Khan, Omar Mubin

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Human-robot interaction has emerged as an increasingly prominent discourse within the domain of robotic technologies. In this context, the interaction of both visual and verbal cues assumes an essential role in shaping user experiences. The research problem of this study revolves around investigating the potential impact of auditory attribute alterations in humanoid agents, namely robots and avatars, on users’ emotional responses. The study recruited a participant cohort comprising 14 individuals, aged 18 to 35, to engage in an experimental process of observing avatar videos with distinctive auditory attributes. These attributes encompassed two voice pitches, specifically alto voice and bass voice, as well as two speech styles denoted as frozen style and casual style. Through data collection, a repository of 13,600 data points was amassed from the participants, and subsequently subjected to rigorous analysis via the ANOVA methodology. The empirical findings demonstrate that users reveal sensitive, emotional responsiveness when faced with avatar videos characterized by varying auditory attributes. This pilot study establishes a foundational framework poised to guide future research undertakings aimed at inspiring user experiences through the deliberate manipulation of auditory attributes inherent in humanoid robots and avatars.

Original languageEnglish
Title of host publicationSocial Robotics - 15th International Conference, ICSR 2023, Proceedings
EditorsAbdulaziz Al Ali, John-John Cabibihan, Nader Meskin, Silvia Rossi, Wanyue Jiang, Hongsheng He, Shuzhi Sam Ge
PublisherSpringer Science and Business Media Deutschland GmbH
Number of pages9
ISBN (Print)9789819987146
Publication statusPublished - 2024
Event15th International Conference on Social Robotics, ICSR 2023 - Doha, Qatar
Duration: Dec 3 2023Dec 7 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14453 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference15th International Conference on Social Robotics, ICSR 2023


  • Auditory features
  • Avatar
  • Emotion detection
  • Human-robot interaction
  • User experience

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Human Perception of Emotional Responses to Changes in Auditory Attributes of Humanoid Agents'. Together they form a unique fingerprint.

Cite this