Applied Affective Computing (CSC 570)

I am teaching a new graduate-level Selected Topics course, CSC 570: Applied Affective Computing. This is the second time the course is being offered –it launched in Spring 2023.

In this course, we will explore the design and implementation of affect-driven intelligent systems. Students will gain hands-on experience with a range of devices used to detect human emotions, including brain-computer interfaces, gesture- and posture-based affect recognition, eye-tracking, and physiological sensors. We will cover the machine learning workflow required to build emotion-aware systems, including techniques to gather, filter, and integrate affective data.

Affect—encompassing emotions and moods—is deeply tied to human cognitive processes and reflects what we care about and value. It influences rational decision-making and action selection. Enabling computers to recognize, interpret, and respond to human affective states can narrow the communication gap between emotionally expressive humans and emotionally neutral machines, significantly enhancing human-computer interaction.

Applications in education, healthcare, and entertainment can greatly benefit from affect-aware computing. This course offers practical experience in using multimodal approaches to automatically detect affective states. Students will review affective data collected in experimental settings and will develop affect-driven intelligent applications in one or more target domains such as learning, entertainment, or healthcare.

This is an excellent opportunity for students to:

  • Apply their software engineering skills
  • Learn machine learning techniques tailored for human physiological data
  • Understand the value of human-centered software design
  • Work directly with a variety of sensors and HCI (human-computer interaction) concepts

Lectures

In its 2023 version, this course includes 13 lectures as follows:

  1. Course Presentation
  2. Models of Emotions
  3. Pleasure-Arousal-Dominance Vector
  4. Sensing
  5. Perception
  6. Clustering
  7. Ensemble Methods
  8. Gaze Tracking
  9. Face Gestures
  10. Facial Emotion Recognition
  11. Connecting the Dots
  12. Physiological Sensors
  13. Final Review

Projects