Can a Machine Learning System Outperform Humans in Emotion Recognition?

In 1961, when Carl Sagan learned that a NASA spacecraft to Venus would carry no cameras, because the other scientists considered cameras to be excess weight, he insisted upon and campaigned for the chance to see the alien planet up close. In machine learning (ML)-based facial emotion recognition, is landmark-based training sufficient or does image-based training still have irreplaceable value? I believe that different facial representations can provide different, sometimes complementing views of emotions. When employed collectively, they enable a more reliable group emotion recognition. In this talk, I will first introduce my study of emotion recognition using image-trained ML model vs landmark-trained ML model in the context of a popular deepfake video. My experiment indicates that while the landmark-trained model performs better with articulated facial feature changes, the image-trained model outperforms on subtle facial expressions. Armed with these findings, we will take a tour of my adaptive group emotion recognition system for small discussion groups. After sharing some results using a collection of group discussion videos from YouTube, I will wrap up my talk by showing the benefits of an adaptive ML-based approach that automatically learns from both image and landmark facial representations and goes on to model group emotion dynamics, and augment individual emotion recognition.

Valentina Zhang

Valentina Zhang

Phillips Academy Exeter

Other sessions from: Sessions October 2021

Recommendation Systems and their types In our daily lives

Recommendation Systems and their types In our daily lives

Recommendation systems are everywhere in this world from Netflix movie...

Kaushik Tummalapalli Kaushik Tummalapalli
A Deep Dive Into Machine Learning

A Deep Dive Into Machine Learning

Come and see how you can integrate machine learning into your daily life a...

Narcisse Mbuyu Narcisse Mbuyu
Project Plant AI

Project Plant AI

Just the other day I was reading some articles and I saw an online news ar...

Rishit Dagli Rishit Dagli
Rishabh Singh Rishabh Singh
Rucha Yagnik Rucha Yagnik
Biometric Artificial Intelligence

Biometric Artificial Intelligence

A brief intro about the vast application of Artificial Intelligence and...

Sidharth Sudheer Sidharth Sudheer
Roundtable: MS Learn for Personal Development and In-Class

Roundtable: MS Learn for Personal Development and In-Class

We will bring together some students as well as professors who have experie...

Amir Pourabdollah Amir Pourabdollah
Syed Farhan Ahmad Syed Farhan Ahmad
Dmitry Soshnikov Dmitry Soshnikov
Anaam Sayeda Anaam Sayeda
Rishit Dagli Rishit Dagli
Introduction to Azure Health Bot

Introduction to Azure Health Bot

Azure Health Bot enables users to build a Health Bot by using built-in or...

Shreyan J D Fernandes Shreyan J D Fernandes
Yesasvini Sai Meghana Chikkam Yesasvini Sai Meghana Chikkam