SlideShare a Scribd company logo
FACIAL EXPRESSION
RECOGNITION APP
BEB801- SEMESTER 1
STUDENT: ALEXANDER FERNICOLA N8609373
SUPERVISOR: VINOD CHANDRAN
PURPOSE OF PROJECT
• To design an android application, that is compatible with most
models, specifically android OS 4.4 (KitKat) or later, that can
recognise the users facial expression in a photo or a video.
• Accuracy goal is a 50-70% positive recognition score (due to
lack of resources to train the model with a large enough data
set)
WHY IS THIS PROJECT NEEDED & PRIOR
WORK
• Advances in facial expression recognition (FER) will lead to
advances in affective computing and human computing.
• Modern studies in the field of automatic facial expression
recognition emerged in 2009.
• Major advances in face detection and feature extraction, for
example the Viola-Jones classifier and local binary pattern (LBP)
feature extraction algorithm.
BACKGROUND
INFO ON
MACHINE
LEARNING
• Process of creating a learned
mathematical model to predict
output.
• (x,y) coordinates of points are the
inputs and colours are outputs.
• The model is the line that separates
the points.
• Model is the equation; y = mx + b,
where m is the gradient and b is the
bias.
• Optimization is training the model
to match the output of the model
with the desired output.
• There are many training algorithms
such as support vector machines
PROJECT PLAN
FACE DETECTION
& TRACKING
• Face detected by Viola-Jones
classifier
• The viola jones classifier is a haar
like feature cascade classifier
that uses the adaboost feature
selection algorithm to boost
efficiency.
• Face tracker used in this project
is the Chehra face tracker. 49
fiducial points (green asterisks)
are placed on the face so that
local texture features can be
extracted from around each
point.
• It is important to track the
movements of these points as
RESEARCH
FINDINGS
• Table II shows the accuracy of the
combinations of feature extraction
and selection algorithms.
• Feature selection on second column,
feature extraction on first row.
• Most accurate are LBP+FAP (facial
action points) and mRMR (minimal
Redundancy Maximum Relevance
criterion).
• Exclusively LBP is by far the fastest
feature extraction algorithm
• (L. Zhang et al, Discovering the Best
Feature Extraction and Selection
Algorithms for Spontaneous Facial
Expression Recognition (2012).
2012 IEEE International Conference
on Multimedia and Expo
LOCAL BINARY
PATTERN (LBP)
FEATURE
EXTRACTION
• Compares intensity of 8
neighbouring pixels with
intensity of centre pixel
(threshold value).
• Pixels are compared within
the region around m*n the
fiducial point.
• ‘1’ if higher, ‘0’ if lower.
• Forms a binary pattern of ‘1’s
and ‘0’s.
• Converted to a decimal
number
PLAN FOR BEB802
• Research, evaluate and implement feature selection algorithm,
e.g. PCA (principal component analysis), mRMR or adaboost.
• Research, evaluate and train classifier model, e.g. SVM (support
vector machine), SVDA (support vector discriminant analysis).
• Write android application.
• Possibly train model with facial images from FEEDTUM or NVIE
facial expression databases to improve accuracy.
Ad

More Related Content

What's hot (20)

Facial Expression Recognition System using Deep Convolutional Neural Networks.
Facial Expression Recognition  System using Deep Convolutional Neural Networks.Facial Expression Recognition  System using Deep Convolutional Neural Networks.
Facial Expression Recognition System using Deep Convolutional Neural Networks.
Sandeep Wakchaure
 
Facial emotion recognition
Facial emotion recognitionFacial emotion recognition
Facial emotion recognition
Rahin Patel
 
Object Detection & Tracking
Object Detection & TrackingObject Detection & Tracking
Object Detection & Tracking
Akshay Gujarathi
 
Face Recognition based Lecture Attendance System
Face Recognition based Lecture Attendance SystemFace Recognition based Lecture Attendance System
Face Recognition based Lecture Attendance System
Karmesh Maheshwari
 
Facial expression recognition projc 2 (3) (1)
Facial expression recognition projc 2 (3) (1)Facial expression recognition projc 2 (3) (1)
Facial expression recognition projc 2 (3) (1)
AbhiAchalla
 
Face detection and recognition
Face detection and recognitionFace detection and recognition
Face detection and recognition
Pankaj Thakur
 
Face Detection
Face DetectionFace Detection
Face Detection
Amr Sheta
 
Face Detection
Face DetectionFace Detection
Face Detection
Reber Novanta
 
Emotion Based Music Player.pptx
Emotion Based Music Player.pptxEmotion Based Music Player.pptx
Emotion Based Music Player.pptx
YogeshChaubey2
 
Python Project.pptx
Python Project.pptxPython Project.pptx
Python Project.pptx
TimePass720676
 
Detection and recognition of face using neural network
Detection and recognition of face using neural networkDetection and recognition of face using neural network
Detection and recognition of face using neural network
Smriti Tikoo
 
Image inpainting
Image inpaintingImage inpainting
Image inpainting
Pulkit Goyal
 
human face detection using matlab
human face detection using matlabhuman face detection using matlab
human face detection using matlab
shamima sultana
 
Face detection ppt
Face detection pptFace detection ppt
Face detection ppt
Pooja R
 
Attendance system based on face recognition using python by Raihan Sikdar
Attendance system based on face recognition using python by Raihan SikdarAttendance system based on face recognition using python by Raihan Sikdar
Attendance system based on face recognition using python by Raihan Sikdar
raihansikdar
 
Face detection ppt by Batyrbek
Face detection ppt by Batyrbek Face detection ppt by Batyrbek
Face detection ppt by Batyrbek
Batyrbek Ryskhan
 
Face Detection Attendance System By Arjun Sharma
Face Detection Attendance System By Arjun SharmaFace Detection Attendance System By Arjun Sharma
Face Detection Attendance System By Arjun Sharma
Arjun Agnihotri
 
face detection
face detectionface detection
face detection
Smriti Tikoo
 
Skin Cancer Detection Mini Project With All the Details Attached!
Skin Cancer Detection Mini Project With All the Details Attached!Skin Cancer Detection Mini Project With All the Details Attached!
Skin Cancer Detection Mini Project With All the Details Attached!
princeashishks
 
Facial Image Analysis for age and gender and
Facial Image Analysis for age and gender andFacial Image Analysis for age and gender and
Facial Image Analysis for age and gender and
Yuheng Wang
 
Facial Expression Recognition System using Deep Convolutional Neural Networks.
Facial Expression Recognition  System using Deep Convolutional Neural Networks.Facial Expression Recognition  System using Deep Convolutional Neural Networks.
Facial Expression Recognition System using Deep Convolutional Neural Networks.
Sandeep Wakchaure
 
Facial emotion recognition
Facial emotion recognitionFacial emotion recognition
Facial emotion recognition
Rahin Patel
 
Object Detection & Tracking
Object Detection & TrackingObject Detection & Tracking
Object Detection & Tracking
Akshay Gujarathi
 
Face Recognition based Lecture Attendance System
Face Recognition based Lecture Attendance SystemFace Recognition based Lecture Attendance System
Face Recognition based Lecture Attendance System
Karmesh Maheshwari
 
Facial expression recognition projc 2 (3) (1)
Facial expression recognition projc 2 (3) (1)Facial expression recognition projc 2 (3) (1)
Facial expression recognition projc 2 (3) (1)
AbhiAchalla
 
Face detection and recognition
Face detection and recognitionFace detection and recognition
Face detection and recognition
Pankaj Thakur
 
Face Detection
Face DetectionFace Detection
Face Detection
Amr Sheta
 
Emotion Based Music Player.pptx
Emotion Based Music Player.pptxEmotion Based Music Player.pptx
Emotion Based Music Player.pptx
YogeshChaubey2
 
Detection and recognition of face using neural network
Detection and recognition of face using neural networkDetection and recognition of face using neural network
Detection and recognition of face using neural network
Smriti Tikoo
 
human face detection using matlab
human face detection using matlabhuman face detection using matlab
human face detection using matlab
shamima sultana
 
Face detection ppt
Face detection pptFace detection ppt
Face detection ppt
Pooja R
 
Attendance system based on face recognition using python by Raihan Sikdar
Attendance system based on face recognition using python by Raihan SikdarAttendance system based on face recognition using python by Raihan Sikdar
Attendance system based on face recognition using python by Raihan Sikdar
raihansikdar
 
Face detection ppt by Batyrbek
Face detection ppt by Batyrbek Face detection ppt by Batyrbek
Face detection ppt by Batyrbek
Batyrbek Ryskhan
 
Face Detection Attendance System By Arjun Sharma
Face Detection Attendance System By Arjun SharmaFace Detection Attendance System By Arjun Sharma
Face Detection Attendance System By Arjun Sharma
Arjun Agnihotri
 
Skin Cancer Detection Mini Project With All the Details Attached!
Skin Cancer Detection Mini Project With All the Details Attached!Skin Cancer Detection Mini Project With All the Details Attached!
Skin Cancer Detection Mini Project With All the Details Attached!
princeashishks
 
Facial Image Analysis for age and gender and
Facial Image Analysis for age and gender andFacial Image Analysis for age and gender and
Facial Image Analysis for age and gender and
Yuheng Wang
 

Viewers also liked (15)

A Comprehensive Survey on Human Facial Expression Detection
A Comprehensive Survey on Human Facial Expression DetectionA Comprehensive Survey on Human Facial Expression Detection
A Comprehensive Survey on Human Facial Expression Detection
CSCJournals
 
Face recognition
Face recognitionFace recognition
Face recognition
sandeepsharma1193
 
Face recognition Face Identification
Face recognition Face IdentificationFace recognition Face Identification
Face recognition Face Identification
Kalyan Acharjya
 
Facial recognition locker for android
Facial recognition locker for androidFacial recognition locker for android
Facial recognition locker for android
konark jain
 
HUMAN EMOTION RECOGNIITION SYSTEM
HUMAN EMOTION RECOGNIITION SYSTEMHUMAN EMOTION RECOGNIITION SYSTEM
HUMAN EMOTION RECOGNIITION SYSTEM
soumi sarkar
 
Face Recognition using OpenCV
Face Recognition using OpenCVFace Recognition using OpenCV
Face Recognition using OpenCV
Vasile Chelban
 
Facial expressions
Facial expressionsFacial expressions
Facial expressions
Maria José Parreira Pereira
 
Image Classification And Support Vector Machine
Image Classification And Support Vector MachineImage Classification And Support Vector Machine
Image Classification And Support Vector Machine
Shao-Chuan Wang
 
Facial expressions pp
Facial expressions ppFacial expressions pp
Facial expressions pp
KeriC325
 
Facel expression recognition
Facel expression recognitionFacel expression recognition
Facel expression recognition
Mintoo Jakhmola
 
Facial expression
Facial expressionFacial expression
Facial expression
17791
 
Face Detection techniques
Face Detection techniquesFace Detection techniques
Face Detection techniques
Abhineet Bhamra
 
Support Vector Machines for Classification
Support Vector Machines for ClassificationSupport Vector Machines for Classification
Support Vector Machines for Classification
Prakash Pimpale
 
Face recognition technology - BEST PPT
Face recognition technology - BEST PPTFace recognition technology - BEST PPT
Face recognition technology - BEST PPT
Siddharth Modi
 
Face recognition ppt
Face recognition pptFace recognition ppt
Face recognition ppt
Santosh Kumar
 
A Comprehensive Survey on Human Facial Expression Detection
A Comprehensive Survey on Human Facial Expression DetectionA Comprehensive Survey on Human Facial Expression Detection
A Comprehensive Survey on Human Facial Expression Detection
CSCJournals
 
Face recognition Face Identification
Face recognition Face IdentificationFace recognition Face Identification
Face recognition Face Identification
Kalyan Acharjya
 
Facial recognition locker for android
Facial recognition locker for androidFacial recognition locker for android
Facial recognition locker for android
konark jain
 
HUMAN EMOTION RECOGNIITION SYSTEM
HUMAN EMOTION RECOGNIITION SYSTEMHUMAN EMOTION RECOGNIITION SYSTEM
HUMAN EMOTION RECOGNIITION SYSTEM
soumi sarkar
 
Face Recognition using OpenCV
Face Recognition using OpenCVFace Recognition using OpenCV
Face Recognition using OpenCV
Vasile Chelban
 
Image Classification And Support Vector Machine
Image Classification And Support Vector MachineImage Classification And Support Vector Machine
Image Classification And Support Vector Machine
Shao-Chuan Wang
 
Facial expressions pp
Facial expressions ppFacial expressions pp
Facial expressions pp
KeriC325
 
Facel expression recognition
Facel expression recognitionFacel expression recognition
Facel expression recognition
Mintoo Jakhmola
 
Facial expression
Facial expressionFacial expression
Facial expression
17791
 
Face Detection techniques
Face Detection techniquesFace Detection techniques
Face Detection techniques
Abhineet Bhamra
 
Support Vector Machines for Classification
Support Vector Machines for ClassificationSupport Vector Machines for Classification
Support Vector Machines for Classification
Prakash Pimpale
 
Face recognition technology - BEST PPT
Face recognition technology - BEST PPTFace recognition technology - BEST PPT
Face recognition technology - BEST PPT
Siddharth Modi
 
Face recognition ppt
Face recognition pptFace recognition ppt
Face recognition ppt
Santosh Kumar
 
Ad

Similar to Facial expression recognition android application (20)

Data Mining - Facial Expression Recognition
Data Mining - Facial Expression RecognitionData Mining - Facial Expression Recognition
Data Mining - Facial Expression Recognition
ArshiaSali1
 
Synops emotion recognize
Synops emotion recognizeSynops emotion recognize
Synops emotion recognize
Avdhesh Gupta
 
Emotion Detection Using Facial Expression Recognition to Assist the Visually ...
Emotion Detection Using Facial Expression Recognition to Assist the Visually ...Emotion Detection Using Facial Expression Recognition to Assist the Visually ...
Emotion Detection Using Facial Expression Recognition to Assist the Visually ...
IRJET Journal
 
Facial Expression Recognition Based on Facial Motion Patterns
Facial Expression Recognition Based on Facial Motion PatternsFacial Expression Recognition Based on Facial Motion Patterns
Facial Expression Recognition Based on Facial Motion Patterns
ijeei-iaes
 
LEARNING BASES OF ACTICITY
LEARNING BASES OF ACTICITYLEARNING BASES OF ACTICITY
LEARNING BASES OF ACTICITY
Padma Kannan
 
Real time emotion_detection_from_videos
Real time emotion_detection_from_videosReal time emotion_detection_from_videos
Real time emotion_detection_from_videos
Cafer Yıldız
 
Facial expression recognition based on local binary patterns final
Facial expression recognition based on local binary patterns finalFacial expression recognition based on local binary patterns final
Facial expression recognition based on local binary patterns final
ahmad abdelhafeez
 
Survey on Facial Expression Analysis and Recognition
Survey on Facial Expression Analysis and RecognitionSurvey on Facial Expression Analysis and Recognition
Survey on Facial Expression Analysis and Recognition
IRJET Journal
 
FACIAL EMOTION RECOGNITION
FACIAL EMOTION RECOGNITIONFACIAL EMOTION RECOGNITION
FACIAL EMOTION RECOGNITION
IRJET Journal
 
IRJET-Facial Expression Recognition using Efficient LBP and CNN
IRJET-Facial Expression Recognition using Efficient LBP and CNNIRJET-Facial Expression Recognition using Efficient LBP and CNN
IRJET-Facial Expression Recognition using Efficient LBP and CNN
IRJET Journal
 
Expression invariant face recognition
Expression invariant face recognitionExpression invariant face recognition
Expression invariant face recognition
Sumit Agarwal
 
Predicting Emotions through Facial Expressions
Predicting Emotions through Facial Expressions  Predicting Emotions through Facial Expressions
Predicting Emotions through Facial Expressions
twinkle singh
 
A Study of Method in Facial Emotional Recognitation
A Study of Method in Facial Emotional RecognitationA Study of Method in Facial Emotional Recognitation
A Study of Method in Facial Emotional Recognitation
rahulmonikasharma
 
IRJET- Facial Expression Recognition: Review
IRJET- Facial Expression Recognition: ReviewIRJET- Facial Expression Recognition: Review
IRJET- Facial Expression Recognition: Review
IRJET Journal
 
DC_1
DC_1DC_1
DC_1
Sivashankar yadav
 
Paper id 29201416
Paper id 29201416Paper id 29201416
Paper id 29201416
IJRAT
 
A Literature Review On Emotion Recognition System Using Various Facial Expres...
A Literature Review On Emotion Recognition System Using Various Facial Expres...A Literature Review On Emotion Recognition System Using Various Facial Expres...
A Literature Review On Emotion Recognition System Using Various Facial Expres...
Lisa Graves
 
Ijariie1177
Ijariie1177Ijariie1177
Ijariie1177
IJARIIE JOURNAL
 
Facial Expression Detection for video sequences using local feature extractio...
Facial Expression Detection for video sequences using local feature extractio...Facial Expression Detection for video sequences using local feature extractio...
Facial Expression Detection for video sequences using local feature extractio...
sipij
 
Facial expression recognition
Facial expression recognitionFacial expression recognition
Facial expression recognition
ElyesMiri
 
Data Mining - Facial Expression Recognition
Data Mining - Facial Expression RecognitionData Mining - Facial Expression Recognition
Data Mining - Facial Expression Recognition
ArshiaSali1
 
Synops emotion recognize
Synops emotion recognizeSynops emotion recognize
Synops emotion recognize
Avdhesh Gupta
 
Emotion Detection Using Facial Expression Recognition to Assist the Visually ...
Emotion Detection Using Facial Expression Recognition to Assist the Visually ...Emotion Detection Using Facial Expression Recognition to Assist the Visually ...
Emotion Detection Using Facial Expression Recognition to Assist the Visually ...
IRJET Journal
 
Facial Expression Recognition Based on Facial Motion Patterns
Facial Expression Recognition Based on Facial Motion PatternsFacial Expression Recognition Based on Facial Motion Patterns
Facial Expression Recognition Based on Facial Motion Patterns
ijeei-iaes
 
LEARNING BASES OF ACTICITY
LEARNING BASES OF ACTICITYLEARNING BASES OF ACTICITY
LEARNING BASES OF ACTICITY
Padma Kannan
 
Real time emotion_detection_from_videos
Real time emotion_detection_from_videosReal time emotion_detection_from_videos
Real time emotion_detection_from_videos
Cafer Yıldız
 
Facial expression recognition based on local binary patterns final
Facial expression recognition based on local binary patterns finalFacial expression recognition based on local binary patterns final
Facial expression recognition based on local binary patterns final
ahmad abdelhafeez
 
Survey on Facial Expression Analysis and Recognition
Survey on Facial Expression Analysis and RecognitionSurvey on Facial Expression Analysis and Recognition
Survey on Facial Expression Analysis and Recognition
IRJET Journal
 
FACIAL EMOTION RECOGNITION
FACIAL EMOTION RECOGNITIONFACIAL EMOTION RECOGNITION
FACIAL EMOTION RECOGNITION
IRJET Journal
 
IRJET-Facial Expression Recognition using Efficient LBP and CNN
IRJET-Facial Expression Recognition using Efficient LBP and CNNIRJET-Facial Expression Recognition using Efficient LBP and CNN
IRJET-Facial Expression Recognition using Efficient LBP and CNN
IRJET Journal
 
Expression invariant face recognition
Expression invariant face recognitionExpression invariant face recognition
Expression invariant face recognition
Sumit Agarwal
 
Predicting Emotions through Facial Expressions
Predicting Emotions through Facial Expressions  Predicting Emotions through Facial Expressions
Predicting Emotions through Facial Expressions
twinkle singh
 
A Study of Method in Facial Emotional Recognitation
A Study of Method in Facial Emotional RecognitationA Study of Method in Facial Emotional Recognitation
A Study of Method in Facial Emotional Recognitation
rahulmonikasharma
 
IRJET- Facial Expression Recognition: Review
IRJET- Facial Expression Recognition: ReviewIRJET- Facial Expression Recognition: Review
IRJET- Facial Expression Recognition: Review
IRJET Journal
 
Paper id 29201416
Paper id 29201416Paper id 29201416
Paper id 29201416
IJRAT
 
A Literature Review On Emotion Recognition System Using Various Facial Expres...
A Literature Review On Emotion Recognition System Using Various Facial Expres...A Literature Review On Emotion Recognition System Using Various Facial Expres...
A Literature Review On Emotion Recognition System Using Various Facial Expres...
Lisa Graves
 
Facial Expression Detection for video sequences using local feature extractio...
Facial Expression Detection for video sequences using local feature extractio...Facial Expression Detection for video sequences using local feature extractio...
Facial Expression Detection for video sequences using local feature extractio...
sipij
 
Facial expression recognition
Facial expression recognitionFacial expression recognition
Facial expression recognition
ElyesMiri
 
Ad

Recently uploaded (20)

MS Project - Pelaksanaan Proyek Fisik 2020
MS Project - Pelaksanaan Proyek Fisik 2020MS Project - Pelaksanaan Proyek Fisik 2020
MS Project - Pelaksanaan Proyek Fisik 2020
Bagus ardian
 
Espresso PD Official MP_eng Version.pptx
Espresso PD Official MP_eng Version.pptxEspresso PD Official MP_eng Version.pptx
Espresso PD Official MP_eng Version.pptx
NingChacha1
 
digital computing plotform synopsis.pptx
digital computing plotform synopsis.pptxdigital computing plotform synopsis.pptx
digital computing plotform synopsis.pptx
ssuser2b4c6e1
 
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
Jimmy Lai
 
800483270-Food-Delivery-MERN-Stack-Presentation.pptx
800483270-Food-Delivery-MERN-Stack-Presentation.pptx800483270-Food-Delivery-MERN-Stack-Presentation.pptx
800483270-Food-Delivery-MERN-Stack-Presentation.pptx
54mdaadil
 
Engr. Joel B. Yosores_RMEE_RMP_PMP_MBA.pdf
Engr. Joel B. Yosores_RMEE_RMP_PMP_MBA.pdfEngr. Joel B. Yosores_RMEE_RMP_PMP_MBA.pdf
Engr. Joel B. Yosores_RMEE_RMP_PMP_MBA.pdf
JOEL B. YOSORES
 
Tech innovations management entreprenuer
Tech innovations management entreprenuerTech innovations management entreprenuer
Tech innovations management entreprenuer
Subramanyambharathis
 
Assessment of Statistical Models for Rainfall Forecasting Using Machine Learn...
Assessment of Statistical Models for Rainfall Forecasting Using Machine Learn...Assessment of Statistical Models for Rainfall Forecasting Using Machine Learn...
Assessment of Statistical Models for Rainfall Forecasting Using Machine Learn...
Journal of Soft Computing in Civil Engineering
 
Full_Cybersecurity_Project_Report_30_Pages.pdf
Full_Cybersecurity_Project_Report_30_Pages.pdfFull_Cybersecurity_Project_Report_30_Pages.pdf
Full_Cybersecurity_Project_Report_30_Pages.pdf
Arun446808
 
EHSS Orientation 2023 - Copy.Orientation
EHSS Orientation 2023 - Copy.OrientationEHSS Orientation 2023 - Copy.Orientation
EHSS Orientation 2023 - Copy.Orientation
GulfamShahzad11
 
An Explicit Formulation for Estimation of Structural Number (SN) of Flexible ...
An Explicit Formulation for Estimation of Structural Number (SN) of Flexible ...An Explicit Formulation for Estimation of Structural Number (SN) of Flexible ...
An Explicit Formulation for Estimation of Structural Number (SN) of Flexible ...
Journal of Soft Computing in Civil Engineering
 
Jeff Menashe - A Dedicated Senior Software Engineer
Jeff Menashe - A Dedicated Senior Software EngineerJeff Menashe - A Dedicated Senior Software Engineer
Jeff Menashe - A Dedicated Senior Software Engineer
Jeff Menashe
 
🚀 TDX Bengaluru 2025 Unwrapped: Key Highlights, Innovations & Trailblazer Tak...
🚀 TDX Bengaluru 2025 Unwrapped: Key Highlights, Innovations & Trailblazer Tak...🚀 TDX Bengaluru 2025 Unwrapped: Key Highlights, Innovations & Trailblazer Tak...
🚀 TDX Bengaluru 2025 Unwrapped: Key Highlights, Innovations & Trailblazer Tak...
SanjeetMishra29
 
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFTDeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
Kyohei Ito
 
VISHAL KUMAR SINGH Latest Resume with updated details
VISHAL KUMAR SINGH Latest Resume with updated detailsVISHAL KUMAR SINGH Latest Resume with updated details
VISHAL KUMAR SINGH Latest Resume with updated details
Vishal Kumar Singh
 
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptxUnleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
SanjeetMishra29
 
AI Chatbots & Software Development Teams
AI Chatbots & Software Development TeamsAI Chatbots & Software Development Teams
AI Chatbots & Software Development Teams
Joe Krall
 
Dr. Shivu___Machine Learning_Module 2pdf
Dr. Shivu___Machine Learning_Module 2pdfDr. Shivu___Machine Learning_Module 2pdf
Dr. Shivu___Machine Learning_Module 2pdf
Dr. Shivashankar
 
Full document for AI powered resume Analyzer
Full document for AI powered resume AnalyzerFull document for AI powered resume Analyzer
Full document for AI powered resume Analyzer
4213SWARNABCSE
 
A New Enhanced Hybrid Grey Wolf Optimizer (GWO) Combined with Elephant Herdin...
A New Enhanced Hybrid Grey Wolf Optimizer (GWO) Combined with Elephant Herdin...A New Enhanced Hybrid Grey Wolf Optimizer (GWO) Combined with Elephant Herdin...
A New Enhanced Hybrid Grey Wolf Optimizer (GWO) Combined with Elephant Herdin...
Journal of Soft Computing in Civil Engineering
 
MS Project - Pelaksanaan Proyek Fisik 2020
MS Project - Pelaksanaan Proyek Fisik 2020MS Project - Pelaksanaan Proyek Fisik 2020
MS Project - Pelaksanaan Proyek Fisik 2020
Bagus ardian
 
Espresso PD Official MP_eng Version.pptx
Espresso PD Official MP_eng Version.pptxEspresso PD Official MP_eng Version.pptx
Espresso PD Official MP_eng Version.pptx
NingChacha1
 
digital computing plotform synopsis.pptx
digital computing plotform synopsis.pptxdigital computing plotform synopsis.pptx
digital computing plotform synopsis.pptx
ssuser2b4c6e1
 
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
Jimmy Lai
 
800483270-Food-Delivery-MERN-Stack-Presentation.pptx
800483270-Food-Delivery-MERN-Stack-Presentation.pptx800483270-Food-Delivery-MERN-Stack-Presentation.pptx
800483270-Food-Delivery-MERN-Stack-Presentation.pptx
54mdaadil
 
Engr. Joel B. Yosores_RMEE_RMP_PMP_MBA.pdf
Engr. Joel B. Yosores_RMEE_RMP_PMP_MBA.pdfEngr. Joel B. Yosores_RMEE_RMP_PMP_MBA.pdf
Engr. Joel B. Yosores_RMEE_RMP_PMP_MBA.pdf
JOEL B. YOSORES
 
Tech innovations management entreprenuer
Tech innovations management entreprenuerTech innovations management entreprenuer
Tech innovations management entreprenuer
Subramanyambharathis
 
Full_Cybersecurity_Project_Report_30_Pages.pdf
Full_Cybersecurity_Project_Report_30_Pages.pdfFull_Cybersecurity_Project_Report_30_Pages.pdf
Full_Cybersecurity_Project_Report_30_Pages.pdf
Arun446808
 
EHSS Orientation 2023 - Copy.Orientation
EHSS Orientation 2023 - Copy.OrientationEHSS Orientation 2023 - Copy.Orientation
EHSS Orientation 2023 - Copy.Orientation
GulfamShahzad11
 
Jeff Menashe - A Dedicated Senior Software Engineer
Jeff Menashe - A Dedicated Senior Software EngineerJeff Menashe - A Dedicated Senior Software Engineer
Jeff Menashe - A Dedicated Senior Software Engineer
Jeff Menashe
 
🚀 TDX Bengaluru 2025 Unwrapped: Key Highlights, Innovations & Trailblazer Tak...
🚀 TDX Bengaluru 2025 Unwrapped: Key Highlights, Innovations & Trailblazer Tak...🚀 TDX Bengaluru 2025 Unwrapped: Key Highlights, Innovations & Trailblazer Tak...
🚀 TDX Bengaluru 2025 Unwrapped: Key Highlights, Innovations & Trailblazer Tak...
SanjeetMishra29
 
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFTDeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
Kyohei Ito
 
VISHAL KUMAR SINGH Latest Resume with updated details
VISHAL KUMAR SINGH Latest Resume with updated detailsVISHAL KUMAR SINGH Latest Resume with updated details
VISHAL KUMAR SINGH Latest Resume with updated details
Vishal Kumar Singh
 
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptxUnleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
SanjeetMishra29
 
AI Chatbots & Software Development Teams
AI Chatbots & Software Development TeamsAI Chatbots & Software Development Teams
AI Chatbots & Software Development Teams
Joe Krall
 
Dr. Shivu___Machine Learning_Module 2pdf
Dr. Shivu___Machine Learning_Module 2pdfDr. Shivu___Machine Learning_Module 2pdf
Dr. Shivu___Machine Learning_Module 2pdf
Dr. Shivashankar
 
Full document for AI powered resume Analyzer
Full document for AI powered resume AnalyzerFull document for AI powered resume Analyzer
Full document for AI powered resume Analyzer
4213SWARNABCSE
 

Facial expression recognition android application

  • 1. FACIAL EXPRESSION RECOGNITION APP BEB801- SEMESTER 1 STUDENT: ALEXANDER FERNICOLA N8609373 SUPERVISOR: VINOD CHANDRAN
  • 2. PURPOSE OF PROJECT • To design an android application, that is compatible with most models, specifically android OS 4.4 (KitKat) or later, that can recognise the users facial expression in a photo or a video. • Accuracy goal is a 50-70% positive recognition score (due to lack of resources to train the model with a large enough data set)
  • 3. WHY IS THIS PROJECT NEEDED & PRIOR WORK • Advances in facial expression recognition (FER) will lead to advances in affective computing and human computing. • Modern studies in the field of automatic facial expression recognition emerged in 2009. • Major advances in face detection and feature extraction, for example the Viola-Jones classifier and local binary pattern (LBP) feature extraction algorithm.
  • 4. BACKGROUND INFO ON MACHINE LEARNING • Process of creating a learned mathematical model to predict output. • (x,y) coordinates of points are the inputs and colours are outputs. • The model is the line that separates the points. • Model is the equation; y = mx + b, where m is the gradient and b is the bias. • Optimization is training the model to match the output of the model with the desired output. • There are many training algorithms such as support vector machines
  • 6. FACE DETECTION & TRACKING • Face detected by Viola-Jones classifier • The viola jones classifier is a haar like feature cascade classifier that uses the adaboost feature selection algorithm to boost efficiency. • Face tracker used in this project is the Chehra face tracker. 49 fiducial points (green asterisks) are placed on the face so that local texture features can be extracted from around each point. • It is important to track the movements of these points as
  • 7. RESEARCH FINDINGS • Table II shows the accuracy of the combinations of feature extraction and selection algorithms. • Feature selection on second column, feature extraction on first row. • Most accurate are LBP+FAP (facial action points) and mRMR (minimal Redundancy Maximum Relevance criterion). • Exclusively LBP is by far the fastest feature extraction algorithm • (L. Zhang et al, Discovering the Best Feature Extraction and Selection Algorithms for Spontaneous Facial Expression Recognition (2012). 2012 IEEE International Conference on Multimedia and Expo
  • 8. LOCAL BINARY PATTERN (LBP) FEATURE EXTRACTION • Compares intensity of 8 neighbouring pixels with intensity of centre pixel (threshold value). • Pixels are compared within the region around m*n the fiducial point. • ‘1’ if higher, ‘0’ if lower. • Forms a binary pattern of ‘1’s and ‘0’s. • Converted to a decimal number
  • 9. PLAN FOR BEB802 • Research, evaluate and implement feature selection algorithm, e.g. PCA (principal component analysis), mRMR or adaboost. • Research, evaluate and train classifier model, e.g. SVM (support vector machine), SVDA (support vector discriminant analysis). • Write android application. • Possibly train model with facial images from FEEDTUM or NVIE facial expression databases to improve accuracy.
  翻译: