scholarly journals Fusion of Features and Extreme Learning Machine for Facial Expression Recognition

2019 ◽  
Vol 15 (12) ◽  
pp. 1833-1841
Author(s):  
Bayezid Islam ◽  
Arfat Hossain
Keyword(s):  
Facial Expression ◽  
Extreme Learning Machine ◽  
Facial Expression Recognition ◽  
Expression Recognition ◽  
Learning Machine

scholarly journals Facial Expression Recognition of Instructor Using Deep Features and Extreme Learning Machine

2021 ◽  
Vol 2021 ◽  
pp. 1-17
Author(s):  
Yusra Khalid Bhatti ◽  
Afshan Jamil ◽  
Nudrat Nida ◽  
Muhammad Haroon Yousaf ◽  
Serestina Viriri ◽  
...  
Keyword(s):  
Facial Expression ◽  
Extreme Learning Machine ◽  
Facial Expressions ◽  
Classroom Environment ◽  
Facial Expression Recognition ◽  
Parameter Tuning ◽  
Expression Recognition ◽  
Fast Learning ◽  
Learning Machine ◽  
The Impact

Classroom communication involves teacher’s behavior and student’s responses. Extensive research has been done on the analysis of student’s facial expressions, but the impact of instructor’s facial expressions is yet an unexplored area of research. Facial expression recognition has the potential to predict the impact of teacher’s emotions in a classroom environment. Intelligent assessment of instructor behavior during lecture delivery not only might improve the learning environment but also could save time and resources utilized in manual assessment strategies. To address the issue of manual assessment, we propose an instructor’s facial expression recognition approach within a classroom using a feedforward learning model. First, the face is detected from the acquired lecture videos and key frames are selected, discarding all the redundant frames for effective high-level feature extraction. Then, deep features are extracted using multiple convolution neural networks along with parameter tuning which are then fed to a classifier. For fast learning and good generalization of the algorithm, a regularized extreme learning machine (RELM) classifier is employed which classifies five different expressions of the instructor within the classroom. Experiments are conducted on a newly created instructor’s facial expression dataset in classroom environments plus three benchmark facial datasets, i.e., Cohn–Kanade, the Japanese Female Facial Expression (JAFFE) dataset, and the Facial Expression Recognition 2013 (FER2013) dataset. Furthermore, the proposed method is compared with state-of-the-art techniques, traditional classifiers, and convolutional neural models. Experimentation results indicate significant performance gain on parameters such as accuracy, F1-score, and recall.

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

2019 ◽  
Vol 23 (3) ◽  
pp. 444-455 ◽  
Author(s):  
Zhen-Tao Liu ◽  
Si-Han Li ◽  
Wei-Hua Cao ◽  
Dan-Yun Li ◽  
Man Hao ◽  
...  
Keyword(s):  
Facial Expression ◽  
Extreme Learning Machine ◽  
Facial Expression Recognition ◽  
Local Binary Pattern ◽  
Human Robot Interaction ◽  
Support Vector ◽  
Expression Recognition ◽  
Robot Interaction ◽  
Interaction Detection ◽  
Learning Machine

The efficiency of facial expression recognition (FER) is important for human-robot interaction. Detection of the facial region, extraction of discriminative facial expression features, and identification of categories of facial expressions are all related to the recognition accuracy and time-efficiency. An FER framework is proposed, in which 2D Gabor and local binary pattern (LBP) are combined to extract discriminative features of salient facial expression patches, and extreme learning machine (ELM) is adopted to identify facial expression categories. The combination of 2D Gabor and LBP can not only describe multiscale and multidirectional textural features, but also capture small local details. The FER of ELM and support vector machine (SVM) is performed using the Japanese female facial expression database and extended Cohn-Kanade database, respectively, in which both ELM and SVM achieve an accuracy of more than 85%, and the computational efficiency of ELM is higher than that of SVM. The proposed framework has been used in the multimodal emotional communication based humans-robots interaction system, in which FER within 2 seconds enables real-time human-robot interaction.

Sign in / Sign up

Export Citation Format

Share Document