Multimodal Affect Recognition in Virtual Worlds: Avatars Mirroring User’s Affect

We get a demo accepted to ACII 2013!

Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII)
Geneva, Switzerland. 2-5 September, 2013

Our demo showcase the integration of a generic real-time multimodal affect recognition tool in Second Life (a 3D virtual world)®.

Abstract

Virtual worlds enable users’ interactions through avatars. Avatars embody individual characteristics from their owners and exhibit those characteristics outward to the community. Motivated by the role of avatars in interpersonal communication, we integrated a generic real-time multimodal affect recognition hub as an input within an online virtual world to make an avatar mirror its owner’s affect. Affect vectors (determined by pleasure, arousal, and dominance coordinates) in a continuous affective space are applied to characterize the user’s affective state in real time.

Video Preview

Reference

Gonzalez-Sanchez J, Chavez-Echeagaray M.E., Gibson D., and Atkinson R. (2013). Multimodal Affect Recognition in Virtual Worlds: Avatars Mirroring User’s Affect. Proceedings of the Humaine Conference on Affective Computing and Intelligent Interaction (ACII). Geneva, Switzerland. September 2013. IEEE Press. Pages 724-725. ISSN: 2156-8103.

doi: 10.1109/ACII.2013.133