The Landscape of Emotions in Virtual Communication: A Multimodal Analysis of Metaverse Interactions
DOI:
https://doi.org/10.62872/2tz5d616Keywords:
Metaverse, Emotions, Virtual Communication, Avatar, MultimodalAbstract
The development of the metaverse as an immersive virtual space has changed the pattern of human communication by presenting multimodal interactions involving verbal, non-verbal, and digital environmental aspects, this study aims to analyze the emotional landscape in virtual communication in the metaverse through a multimodal approach with the Systematic Literature Review (SLR) method based on the PRISMA 2020 guidelines. From the results of the review of 25 selected articles, it was found that non-verbal avatar expressions, such as gestures and digital facial expressions, have a dominant contribution to the perception of emotions, while verbal communication plays a limited role and the virtual environment functions as a modulator of emotional experience, the integration of these three modalities results in more authentic emotional experiences, increases empathy, and strengthens social involvement in digital interactions. This research provides practical implications for more realistic avatar design, the development of interactive virtual environments, and the application of multimodal approaches to improve the quality of communication and psychological well-being of users in the metaverse.
Downloads
References
1. Chung, K., Park, S., & Kim, H. (2022). Virtual social interactions and emotional intelligence: Insights from metaverse platforms. International Journal of Human-Computer Studies, 160, 102742.
2. Gao, L., Wang, Y., & Li, J. (2020). Emotional engagement in immersive virtual environments. Frontiers in Psychology, 11, 576345. https://doi.org/10.3389/fpsyg.2020.576345
3. Gao, Y., Li, X., & Zhang, W. (2020). Multimodal emotion analysis in online virtual spaces. Journal of Virtual Worlds Research, 13(2), 45–62.
4. Hassouneh, D., & Brengman, M. (2020). Virtual worlds and emotional experience: The role of avatars. Computers in Human Behavior, 105, 106–118. https://doi.org/10.1016/j.chb.2019.106118
5. Huang, R., Liu, J., & Tsai, C. (2020). The role of non-verbal cues in virtual communication. International Journal of Human-Computer Studies, 138, 102400.
6. Huang, T., Chen, Y., & Wu, S. (2020). Social presence and emotion expression in online virtual communities. Cyberpsychology, Behavior, and Social Networking, 23(12), 810–819. https://doi.org/10.1089/cyber.2020.0293
7. Kwon, H., Park, J., & Lee, S. (2023). Avatars and emotional perception in metaverse interaction. Virtual Reality, 27(1), 25–42. https://doi.org/10.1007/s10055-022-00656-5
8. Lee, C., & Chen, H. (2022). Emotional engagement in virtual environments: Evidence from avatar interactions. Virtual Reality, 26, 317–333.
9. Lee, S., & Chen, Y. (2022). Multimodal analysis of emotion in virtual reality. Journal of Computer-Mediated Communication, 27(4), 202–220. https://doi.org/10.1093/jcmc/zmac008
10. Li, F., & Wang, Y. (2021). Multimodal emotion detection in online gaming environments. Entertainment Computing, 39, 100465.
11. Li, H., & Wang, Y. (2021). Emotional dynamics in immersive digital platforms. International Journal of Human-Computer Interaction, 37(12), 1154–1166. https://doi.org/10.1080/10447318.2021.1913762
12. Li, J., Zhao, X., & Chen, Y. (2021). Avatar-mediated emotion communication in digital environments. Computers & Education, 168, 104206. https://doi.org/10.1016/j.compedu.2021.104206
13. Li, X., Zhang, W., & Liu, Q. (2021). Avatar customization and emotional expression in virtual reality. Computers & Education, 168, 104199.
14. Li, Y., Tan, S., & Wu, Z. (2021). Multimodal communication in virtual collaboration platforms. International Journal of Human-Computer Interaction, 37(16), 1519–1532.
15. Liang, X., Huang, Y., & Zhao, J. (2020). User experience and emotional perception in virtual spaces. Frontiers in Psychology, 11, 567892. https://doi.org/10.3389/fpsyg.2020.567892
16. Nguyen, P., & Tran, T. (2021). Understanding virtual emotion: A cross-cultural perspective. Journal of Digital Social Research, 3(2), 34–50.
17. Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLOS Med, 18(3), e1003583. https://doi.org/10.1371/journal.pmed.1003583
18. Park, S., & Kim, H. (2022). Emotional perception and avatar design in virtual environments. Journal of Information Technology & People, 35(6), 1400–1420.
19. Zhang, Y., & Li, H. (2025). Environmental cues and emotional responses in metaverse interactions. Computers in Human Behavior, 164, 107731. https://doi.org/10.1016/j.chb.2025.107731
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Erika Febriana (Author)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
