1 of 19

Rosalind Picard

Professor, MIT Media Lab

Founding Director, Affective Computing Research Group, Media Lab

Co-founder, Affectiva Inc.

Co-founder, Empatica Inc.

​

2 of 19

About Rosalind

​

PhD Advisor: Alex(Sandy) Pentland

�Alma Mater (Grad): MIT(1984-1986, 1987-1991)

​

Alma Mater (UGrad): Georgia Institute of Technology(1980-1984)

​

Awards: IEEE fellow, National Academy of Engineering

​

Frequented Venues: IEEE Transactions on Affective Computing,

ACII, AAAC,

​

Research Areas: Affective Computing, Emotional Intelligence,

Health & Wellbeing, Physiological Signal Processing, HCI

​

Alex Pentland

Rosalind Picard

Thad

Starner

Tanzeem Choudhury

3 of 19

Career Path

1991

Student

1995

Assistant Professor

2005

1980

Associate Professor

Professor

2010

2013

4 of 19

Startups

  • Affectiva
    • Track human perception in Automotive and conversational interfaces
    • ~62.6M total funding
    • 50 - 200 employees
    • Left in 2013
  • Empatica
    • Medical Wearables and AI
    • ~7.8M total funding
    • <50 employees

5 of 19

Research Timeline

1991

Texture modeling

1997

Affective Computing

2001

Physiological

Sensing

Mobile Emotional Health

Add emotion to HCI/HRI

6 of 19

PhD Era

--not really related to her research as a faculty

  • Signal Processing(part of a book)
  • Speech processing Research Program
  • Markov/Gibbs texture modeling: Aura matrices and temperature effects
  • Texture Modeling--temperature Effects on Markov/Gibbs Random Fields(Thesis)
  • Miscibility matrices explain the behavior of gray-scale textures generated by Gibbs random fields

7 of 19

Affective Computing, 1997

  • Sensing emotions
    • Face
    • Voice
    • Body
    • heart rate, diastolic and systolic blood pressure, pulse, pupillary dilation, respiration, skin conductance and temperature...
  • Wearable computers
  • Give computer emotions

​

8 of 19

TED Talk: Technology and Emotions

9 of 19

Sensing Emotion

  • Emotional speech
  • Facial affect
    • Expression
    • Facial color
  • Body gesture
  • Physiological signals
    • PPG
    • EMG
    • Skin response(conductance etc.)
    • temperature

​

10 of 19

Wearables for emotion and health

2002

2010

11 of 19

  • Help people express their emotions
    • Autism
    • Kids

​

  • Help others understand people’s emotions

​

12 of 19

Machine emotional intelligence

​

  • Problematic day-to-day variation

​

  • 81% recognition accuracy on eight classes of emotion, including neutral

​

  • affective feedback is important for HCI

​

Toward machine emotional intelligence: Analysis of affective physiological state, 2001

13 of 19

Add emotion to computing device?

Eyecam:

14 of 19

Health and Wellbeing: Visual PPG

Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. 2010

15 of 19

Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam, 2011

Visual PPG

  • Physiological measurements
    • Heart rate
    • Respiratory rate
    • Heart rate variability

16 of 19

Impact -- other rPPG research

  • Heart rate, heart rate variability, Afib…

​

  • Indicator of stress

​

  • Deep learning based rPPG

​

  • rPPG for blood pressure

Daniel McDuff, MSR

17 of 19

Current Research

​

  • emotional feedback for robots and computers

​

  • health and wellbeing

​

  • Forecast and prevent stress, depression

​

  • help people with face communication, motivation, and emotion regulation challenges

18 of 19

Discussion

  • What can we do with emotion
    • Though ground truth is hard
  • Pioneer in a research field
    • Hard to publish?
  • Research during PhD vs research after that
    • What makes the change?
    • Get a faculty position without dozens of publications?
  • ​

19 of 19

Thanks!