The Metaverse is defined as an interconnected network of 3D environments that enable multisensory interactions with virtual environments, digital objects, and people. A central component of a Metaverse is the realism of human interaction with the environment and each other, which is achieved through emotional expression. However, there are limitations in realistically representing human emotions and facial expressions in real time through virtual avatars. In this paper, the authors present a research project called Meta-EmoVis aimed at improving the realism of the Metaverse by detecting human facial expressions and translating them into emotional feedback that influences aspects of the virtual avatar and environment. The Emoj tool is used to collect data and map facial expressions to basic emotions, as well as detect the human engagement level. The goal is to create a world of real social interaction and emotional sharing in virtual spaces that are sensitive and adaptive to human emotional and mental states. Preliminary user tests to evaluate the effectiveness of the application are presented.
Empowering Virtual Humans’ Emotional Expression in the Metaverse / Spadoni, E.; Carulli, M.; Mengoni, M.; Luciani, M.; Bordegoni, M.. - ELETTRONICO. - 14021:(2023), pp. 133-143. (Intervento presentato al convegno 17th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2023, held as part of the 25th International Conference on Human-Computer Interaction, HCII 2023 tenutosi a Copenhagen, Danimark nel 2023) [10.1007/978-3-031-35897-5_10].
Empowering Virtual Humans’ Emotional Expression in the Metaverse
Mengoni M.;
2023-01-01
Abstract
The Metaverse is defined as an interconnected network of 3D environments that enable multisensory interactions with virtual environments, digital objects, and people. A central component of a Metaverse is the realism of human interaction with the environment and each other, which is achieved through emotional expression. However, there are limitations in realistically representing human emotions and facial expressions in real time through virtual avatars. In this paper, the authors present a research project called Meta-EmoVis aimed at improving the realism of the Metaverse by detecting human facial expressions and translating them into emotional feedback that influences aspects of the virtual avatar and environment. The Emoj tool is used to collect data and map facial expressions to basic emotions, as well as detect the human engagement level. The goal is to create a world of real social interaction and emotional sharing in virtual spaces that are sensitive and adaptive to human emotional and mental states. Preliminary user tests to evaluate the effectiveness of the application are presented.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
