poster: (ACII 2013) Multimodal Affect Recognition in Virtual Worlds: Avatars Mirroring User’s Affect


A demo accepted to ACII 2013 !

Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII)
Geneva, Switzerland. 2-5 September, 2013
Demo

This demo showcase the integration of a generic real-time multimodal affect recognition tool in a 3D virtual world – Second Life®.

Video Preview

Abstract

Virtual worlds enable users’ interactions through avatars. Avatars embody individual characteristics from their owners and exhibit those characteristics outward to the community. Motivated by the role of avatars in interpersonal communication, we integrated a generic real-time multimodal affect recognition hub as an input within an online virtual world to make an avatar mirror its owner’s affect. Affect vectors (determined by pleasure, arousal, and dominance coordinates) in a continuous affective space are applied to characterize the user’s affective state in real time.

Reference

Gonzalez-Sanchez J, Chavez-Echeagaray M.E., Gibson D., and Atkinson R. (2013). Multimodal Affect Recognition in Virtual Worlds: Avatars Mirroring User’s Affect. Proceedings of the Humaine Conference on Affective Computing and Intelligent Interaction (ACII). Geneva, Switzerland. September 2013. IEEE Press. Pages 724-725. ISSN: 2156-8103. doi: 10.1109/ACII.2013.133.