Improved Model for Facial Expression Classification for Fear and Sadness Using Local Binary Pattern Histogram

Main Article Content

Adebola K. Ojo
Temitope Ololade Idowu


In this study, a Local Binary Pattern Histogram model was proposed for Facial expression classification for fear and sadness. There have been a number of supervised machine models developed and used for facial recognition in past researches. The classifier requires human effort to perform feature extraction which has led to unknown changes in the expression of human face and incomplete feature extraction and low accuracy. This study proposed a model for improving the accuracies for fear and sadness and to extract features to distinguish between fear and sadness. Images of different people of varying ages were extracted from two datasets got from Japanese female facial expression (jaffe) dataset and Cohn cade got from Kaggle. In other to achieve an incremental development, classification was done using Linear Support Vector Machine (LSVM) and Random Forest Classifier (RFC). The accuracy rates for the LSVM models, LSVM1 and LSVM2 were 88% and 87% respectively while the RFC models, RFC1 and RFC2, were 81% and 82% respectively.

Facial expression, feature extraction, classification, local binary pattern histogram, histogram-oriented gradient.

Article Details

How to Cite
Ojo, A. K., & Idowu, T. O. (2020). Improved Model for Facial Expression Classification for Fear and Sadness Using Local Binary Pattern Histogram. Journal of Advances in Mathematics and Computer Science, 35(5), 22-33.
Original Research Article


Kaustubh Kulkarni, Ciprian Adrian Corneanu, Ikechukwu Ofodile, Sergio Escalera, Xavier Baro, Sylwia Hyniewska, Juri Allik, Gholamreza Anbarjafari. Automatic recognition of facial displays of unfelt emotions. Journal of IEEE Transactions on Affective Computing; 2018.

Fernando De la Torre, Jeffrey F. Cohn. Facial expression analysis. In Visual Analysis of Humans, London; 2011.

Shiqing Zhang, Xiaoming Zhao, Yuelong Chuang, Wenping Guo, Ying Chen. Learning discriminative dictionary for facial expression recognition. IETE Technical Review. 2017;35(3):1-7.

Yang Alsadon A, Prasad PWC, Singh AK, Elchouemi A. An emotion recognition model based on facial recognition in virtual learning environment. Science Direct Procedia Computer Science. 2018;125(2009):2-10.

Mu-Chun Su, Chun-Kai Yang, Shih-Chieh Lin, De Yuan Huang, Yi-Zeng Hsieh, Pa-Chun Wang. An SOM-based automatic facial expression recognition system. International Journal on Soft Computing, Artificial Intelligence and Application (IJSCAI). 2013;2(4).

Navdeep Kaur, Er. Varinderjit Kaur. Improved emotion detection by regression algorithm with SURF feature and SVM. International Journal of Engineering and Computer Science. 2014;3(10):8639-8642.

Kumari J, Rajesh R, Pooja KM. Facial expression recognition: A survey. In Procedia - Procedia Computer Science; 2015.

Kai Tai Song, Shuo-Cheng. Facial expression recognition based on basic expressions. IJSR. 2016;5(2).

Urvashi Bakshi R. Singhal. A new approach of face recognition using DCT, PCA and neural network in Matlab. International Journal of Emerging Trends & Technology in Computer Science (IJETTCS). 2014;3(3).

Jizheng Yi, Xia Mao, Lijiang Chen, Yuli Xue. Facial expression recognition considering individual differences in facial structure and texture. IET Computer Vision. 2014;8(5):429-440.

Caifeng Shan, Tommaso Gritti. Learning discriminative LBP-Histogram bins for facial expression recognition, 36, Eindhoven 5656 AE The Netherlands.

Prakasa. Texture feature extraction by using local binary pattern. Jurnal INKOM. 2016;9(2):45-48.

Ahonen Timo, Pietikäinen, Matti. Soft histograms for local binary patterns. In Proc. Finnish Signal Processing Symposium (FINSIG); 2007.

Yiu T. Understanding Random Forest, 12 June. [Online]; 2019.


Michael J. Lyons, Shigeru Akamatsu, Miyuki Kamachi, Jiro Gyoba. Jaffe dataset: Coding facial expressions with Gabor wavelets. In Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara Japan; 1998.