SpaHeron_MachineLearning_UXIS

Lecture score calculator with iris location using madiapipe.

eye_tracking

Based on https://github.com/antoinelame/GazeTracking
Print pupil's position, using HOG + DNN(maybe?) face detection.
Detect face with HOG. Try detecting face with DNN, if face is not detected.
While HOG prints pupil properly, DNN prints only CENTER of eye.
Webcam version.

mediapipe

Based on https://github.com/google/mediapipe
Edit iris_trakcing part.
Calculate both eye's iris location.
The result of output is as followed.

OH MY GIRL - SEUNG

State Calculation

Communicate with mediapipe program by 'Named pipe' to share iris's location(see mediapipe/pipe).
State value: 0 - ATTEND, 1 - ABSCENT, 2 - CONCENTRATE, 3 - DISTRACT
Structure

ML

Score prediction using multiple linear regression.
Input: an array with 4 states counted individually / output: lecture score.