presentations » tutorials

Multimodal Detection of Affective States: A Roadmap from Brain-Computer Interfaces, Face-Based Emotion Recognition, Eye Tracking and Other Sensors

javiergs

🙂

We are going to be presenting this tutorial at CHI2012

ACM Conference on Human Factors in Computing Systems
Austin, Texas, USA. May 2012
Tutorial.
2-session(s): May 9, 14:30-15:50 and May 9, 16:30-17:50 (Room 13B)

This tutorial presents devices and explores methodologies for multimodal detection of affective states, as well as a discussion about presenter’s experiences using them both in learning and gaming scenarios.

Abstract

One novel part of the design of interactions between people and computers, related with the facet of securing user satisfaction, is the capability of systems to adapt to their individual users showing empathy. Being empathetic implies that the computer is able to recognize user’s affective states and understand the implication of those states. Automatic detection of affective states requires the computer: to sense information; to process and understand information integrating several sources that could range from brain-waves signals and biofeedback readings, passing from gestures recognition, to posture and pressure sensing; and to apply algorithms and data processing tools to understand user’s affective states.

Through this course, attendees will:

  1. Learn about sensing approaches used to detect affective states: brain-computer interfaces, face-based emotion recognition systems, eye-tracking system, and physiological sensors –including skin conductivity, posture, and pressure sensors—.
  2. Understand the pros and cons of the diverse sensing approaches used to detect affective states.
  3. Learn about the data that is gathered from each device and understand its characteristics.
  4. Learn about approaches and tools to pre-process, synchronize, and analyze data.

This course is open to researchers, practitioners, and educators interested in incorporating affective computing as part of their adaptive and personalized technology toolbox.

The presentation will be a mix of enthusiastic instruction with demonstrations and exercises, all aimed to help making the topic concrete, memorable, and actionable.

Slides

These are the slides of the tutorial, comments are more than welcome.

Evaluation

I am grateful with all the attendees and their good comments. Thanks!