Original Article

Brain-Inspired Deep Networks for Facial Expression Recognition

Abstract

Purpose: One of the essential problems in deep-learning face recognition research is the use of self-made and less counted data sets, which forces the researcher to work on duplicate and provided data sets. In this research, we try to resolve this problem and get to high accuracy.
Materials and Methods: In the current study, the goal is to identify individual facial expressions in the image or sequence of images that include identifying ten facial expressions. Considering the increasing use of deep learning in recent years, in this study, using the convolution networks and, most importantly, using the concept of transfer learning, led us to use pre-trained networks to train our networks.
Results: One way to improve accuracy in working with less counted data and deep-learning is to use pre-trained using pre-trained networks. Due to the small number of data sets, we used the techniques for data augmentation and eventually tripled the data size. These techniques include: rotating 10 degrees to the left and right and eventually turning to elastic transmation. We also applied deep Res-Net's network to public data sets existing for face expression by data augmentation.
Conclusion: We saw a seven percent increase in accuracy compared to the highest accuracy in previous work on the considering dataset.

1- Rao, K. S., Saroj, V. K., Maity, S. and Koolagudi, S. G. “Recognition of emotions from video using neural network models”, Expert system with application, vol.38, pp. 13181-13185, 2011.
2- Khanam, A., Shafiq, M. Z., and Akram, M. U. “Fuzzy based facial expression recognition”, Congress on Image and Signal Processing, vol. 1, pp. 598-602, 2008.
3- Jamshidenezhad, A. and Nordin, M. J. “An adaptive learning model base genetic for facial expression recognition”. International Journal of Physical Sciences, vol. 7, pp. 619-623, 2012.
4- Ilbeygi, Mahdi, and Hamed Shah-Hosseini. “A Novel fuzzy facial expression recognition system base on facial feature extraction from color face images”, Engineering Applications of Artifical Intelligence, vol. 25, pp. 130-146, 2012.
5- Seifzadeh S, Faez K. A cortex-like model for animal recogni¬tion based on texture using feature-selective hashing. Paper presented at: The 2014 Iranian Conference on Intelligent Systems, Bam, Iran (ICIS); Feb 4-6, 2014.

6- Seifzadeh, Sahar, Mohammad Rezaei, and Omid Farahbakhsh. "A Computational Visual Neuroscience Model for Object Recognition." Journal of Advanced Medical Sciences and Applied Technologies, vol. 2, no.4, pp. 313-320, 2016.
7- Halder, A., Konar, A., Mandal, R., Chakraborty, A., Bhowmik, P., Pal, N. R., and Nagar, A.K. “General and interval type-2 fuzzy face-space approach to emotion recognition”, IEEE Transactions on System, Man and Cybernetics: System, vol. 43, pp. 587-605, 2013.
8- Konar A., Chakraborty, A., Halder, A., Mandal, R., and Janarthanan, R. “Interval type-2 fuzzy model for emotion recognition from the facial expression”, Perception and Machine Intelligence, pp. 114-121, 2012
9- VeenaMayya, Radhika M. Pai, ManoharaPai M. M. “Automatic Facial Expression Recognition Using DCNN”, Procedia Computer Science, vol. 93, pp. 453 – 461, 2016.
10- M. Liu, S. Shan, R. Wang, X. Chen, Learning expressionless on the spatiotemporal manifold for dynamic facial expression recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1749–1756, 2014.
11- P. Liu, S. Han, Z. Meng, Y. Tong, Facial expression recognition via a boosted deep belief network, in: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1805–1812, 2014.
12- Andre Teixeira Lopes,.Edilson de Aguiar,. Alberto F. De Souza., Thiago Oliveira-Santos, “Facial Expression Recognition with Convolution Neural Networks: Coping with Few Data and the Training Sample Order”, Pattern Recognition, vol. 61, pp. 610-628, 2017.
Files
IssueVol 7 No 3 (2020) QRcode
SectionOriginal Article(s)
DOI https://doi.org/10.18502/fbt.v7i3.4619
Keywords
Deep Learning Small Database Face Expression ResNet Network Selfmade Dataset

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
1.
Zeinali N, Faez K, Seifzadeh S. Brain-Inspired Deep Networks for Facial Expression Recognition. Frontiers Biomed Technol. 2020;7(3):170-177.