1 of 11

Students Emotion Detection System

Ali Jbareen | Salih Kadri

@

Prof. Kobi Gal | Dr. Osama Swidan

2 of 11

Average Number of Students in a Class

Source : Knesset 2020

3 of 11

HELP!

  • With Class of more than 20 Students , it's almost impossible task for the Teacher to keep up on the real-time progress of every student.

  • Students who are having problem understanding or solving tasks ,they feel left behind.

  • Facial emotions is an Indicator for the of each student state and can be helpful if we use it :)

4 of 11

BGU IS READY TO ASSIST!

  • a new approach to teaching system

  • Dashboard for monitoring Students emotion

  • help the teacher better grasp the students situation during learning and solving problems

  • Notify when one student is having a trouble , each student will have a camera sensor that detects their emotion .

5 of 11

OUR APPLICATION

6 of 11

Teacher’s Dashboard

7 of 11

SYSTEM DESIGN

8 of 11

Learning with AI | face-api

  • Futuristic approach for Learning System

  • Faster Development

  • Easy to Upgrade

Face-API.js utilizes TensorFlow.js and a pre-trained model based on Convolutional Neural Networks (CNNs) to provide face detection, face recognition, and facial landmark detection.

9 of 11

Problems we faced

  • Ethics
    • Sensitive info - children’s faces are exposed to the web

  • Bandwidth and Network Capacity
    • Multiple videos streaming

  • Scalability
    • Huge processing info on server side

10 of 11

Solutions

  • Load AI module on every client -
    • No children's faces in the web
    • only send the data after being processed

  • Efficient RTC Server -
    • No video streaming - only textual data

  • Scalability -
    • Handle a whole class of Students

11 of 11

THANK YOU !