A Survey on Face Recognition Based on Deep Neural Networks

محورهای موضوعی : Majlesi Journal of Telecommunication Devices

mohsen Norouzi ¹ , Ali Arshaghi ²

1 - Researcher, Faculty of Computer, Imam Hossein University, Tehran, Iran.
2 - Researcher, Faculty of Computer, Imam Hossein University, Tehran, Iran.

تاریخ دریافت : 1401/10/23 تاریخ پذیرش : 1401/12/23 تاریخ انتشار : 1402/09/10

کلید واژه: Convolutional neural networks, Autoencoders, face recognition, Restricted Boltzmann Machine, Artificial Neural Networks,

چکیده مقاله :

Face recognition is one of the most important and challenging issues in computer vision and image processing. About half a century ago, since the first face recognition system was introduced, facial recognition has become one of the most important issues in industry and academia. In recent years, with the developing of computers throughput and developments of a new generation of hierarchical learning algorithms called deep learning, much attention has been devoted to solving learning problems by deep learning algorithms. Deep neural networks perform feature learning instead of feature extraction which by this strategy they are much useful for image processing and computer vision problems. Deep neural network through feature learning perform data representation well and have gained many successes in learning and complex problems, many studies have been done on the application of deep neural networks to face recognition and many successes has been achieved. In this study we examine the neural network based methods used for face recognition such as multilayer perceptrons, restricted Boltzmann machine and auto encoders. Most of our study devoted to convolutional neural network as one of the most successful deep learning algorithms. At the end we have examined the results of the encountered methods on ORL, AR, YALE, FERET datasets and show deep neural network has gained high recognition rate in comparing with benchmark methods.

چکیده انگلیسی:

Face recognition is one of the most important and challenging issues in computer vision and image processing. About half a century ago, since the first face recognition system was introduced, facial recognition has become one of the most important issues in industry and academia. In recent years, with the developing of computers throughput and developments of a new generation of hierarchical learning algorithms called deep learning, much attention has been devoted to solving learning problems by deep learning algorithms. Deep neural networks perform feature learning instead of feature extraction which by this strategy they are much useful for image processing and computer vision problems. Deep neural network through feature learning perform data representation well and have gained many successes in learning and complex problems, many studies have been done on the application of deep neural networks to face recognition and many successes has been achieved. In this study we examine the neural network based methods used for face recognition such as multilayer perceptrons, restricted Boltzmann machine and auto encoders. Most of our study devoted to convolutional neural network as one of the most successful deep learning algorithms. At the end we have examined the results of the encountered methods on ORL, AR, YALE, FERET datasets and show deep neural network has gained high recognition rate in comparing with benchmark methods.

منابع و مأخذ:

• Henry Rowley, Baluja S. & Kanade T. (1999) “Neural Network-Based Face Detection, Computer Vision and Pattern Recognition”, Neural Network-Based Face Detection, Pitts-burgh, Carnegie Mellon University, PhD thesis.


• Debotosh Bhattacharjee, Dipak K. Basu, Mita Nasipuri, Mohantapash Kundu, 2010, Human face recognition using fuzzy multilayer perceptron, Soft Computing, Volume 14, Issue 6, pp 559–570.


• Hayet Boughrara, Mohamed Chtourou. Chokri Ben Amar, Liming Chen, 2016, Facial expression recognition based on a mlp neural network using constructive training algorithm, Multimedia Tools and Applications, Volume 75, Issue 2, pp 709–731.


• González-Ortega, F. J. Díaz-Pernas, M. Antón-Rodríguez, M. Martínez-Zarzuela, J. F. Díez-Higuera, 2013, MLP-based face recognition with Gabor filters and PCA, Volume 23, Issue 1, pp 10–25.


• Zulhadi Zakaria,Shahrel AzminSuandi,Junita Mohamad-Saleh, 2018, Hierarchical Skin-AdaBoost-Neural Network (H-SKANN) for multi-face detection, Applied Soft Computing, Volume 68, Pages 172-190.


• Yoonseop Kang, Kang-Tae Lee, Jihyun Eun, Sung Eun Park, Seungjin Choi, 2013, Stacked Denoising Autoencoders for Face Pose Normalization, ICONIP 2013: Neural Information Processing pp 241-248.


• Chun Chet Tan, C. Eswaran, 2010, Reconstruction and recognition of face and digit images using autoencoders, Neural Computing and Applications, Volume 19, Issue 7, pp 1069–1079.


• Paraskevi Nousi, Anastasios Tefas, 2017, Discriminatively Trained Autoencoders for Fast and Accurate Face Recognition, International Conference on Engineering Applications of Neural Networks, pp 205-215.


• Elaiwat, M.Bennamoun,F.Boussaid, 2016, A spatio-temporal RBM-based model for facial expression recognition, Pattern Recognition, Volume 49,  Pages 152-161.


• Lucy Nwosu ; Hui Wang ;  Jiang Lu ;  Ishaq Unwala ;  Xiaokun Yang ;  Ting Zhang, 2017, Deep Convolutional Neural Network for Facial Expression Recognition Using Facial Parts, 15th Intl Conf on Pervasive Intelligence & Computing.


• Zhi Li, A discriminative learning convolutional neural network for facial expression recognition, 2017, 3rd IEEE International Conference on Computer and Communications.


• Junying Zeng ; Xiaoxiao Zhao ;  Chuanbo Qin ;  Zuoyong Lin, 2017, Single sample per person face recognition based on deep convolutional neural network,   3rd IEEE International Conference on Computer and Communications.


• Nusrat Mubin Ara ; Nishikanto Sarkar Simul ;  Saiful Islam, 2017, Convolutional neural network approach for vision based student recognition system, 20th International Conference of  Computer and Information Technology.


• Behzad Hasani ; Mohammad H. Mahoor, 2017, Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks, IEEE Conference on  Computer Vision and Pattern Recognition Workshops


• Amin Jalali, Giljin Jang, Jun-Su Kang, Minho Lee, 2015, Convolutional Neural Networks Considering Robustness Improvement and Its Application to Face Recognition, pp 240-245.


• Rishav Singh , Hari Om, 2017, Newborn face recognition using deep convolutional neural network, Multimedia Tools and Applications, Volume 76, Issue 18, pp 19005–19015.


• Pejman Rasti, Tõnis Uiboupin, Sergio Escalera, Gholamreza Anbarjafari, 2016, Convolutional Neural Network Super Resolution for Face Recognition in Surveillance Monitoring, International Conference on Articulated Motion and Deformable Objects, pp 175-184


• Yuanyuan Zhang, Dong Zhao, Jiande Sun, Guofeng Zou, Wentao Li, 2016, Adaptive Convolutional Neural Network and Its Application in Face Recognition, Neural Processing Letters, Volume 43, Issue 2, pp 389–399.


• Jakob Grundström, Jiandan Chen, Martin Georg Ljungqvist, Kalle Åström, 2016, Transferring and Compressing Convolutional Neural Networks for Face Representations, International Conference Image Analysis and Recognition, pp 20-29.


• Neha Jain,Shishir Kumar, Amit Kumar, Pourya Shamsolmoali, Masoumeh Zareapoor, 2018, Hybrid deep neural networks for face emotion recognition, Pattern Recognition Letters,


• Licheng Jiao, Sibo Zhang, Lingling Li, Fang Liu, Wenping Ma, 2018, A modified convolutional neural network for face sketch synthesis, Pattern Recognition, Volume 76, Pages 125-136


• Hurieh Khalajzadeh, Mohammad Mansouri, Mohammad Teshnehlab, 2013, Face Recognition Using Convolutional Neural Network and Simple Logistic Classifier, Soft Computing in Industrial Applications, volume 223, pp 197-207.


• Xudie Ren,Haonan Guo, Chong Di, Zhuoran Han, Shenghong Li, 2016, Face Recognition Based on Local Gabor Binary Patterns and Convolutional Neural Network, International Conference in Communications, Signal Processing, and Systems, pp 699-707.


• Jingjing Deng, Xianghua Xie,Michael Edwards, 2016, Combining Stacked Denoising Autoencoders and Random Forests for Face Detection, International Conference on Advanced Concepts for Intelligent Vision Systems, pp 349-360.


• Yang Li,Wenming Zheng, Zhen Cui,Tong Zhang, 2018, Face recognition based on recurrent regression neural network, Neurocomputing, Volume 297, Pages 50-58.


• Fang Zhao ;  Jiashi Feng ;  Jian Zhao ;  Wenhan Yang ; Shuicheng Yan, 2018, Robust LSTM-Autoencoders for Face De-Occlusion in the Wild,  IEEE Transactions on Image Processing, Volume. 27, Issue. 2, Pages 778 – 790.


• The AT & T Database of Faces. Available online: http://www.cl.cam.ac.uk/research/dtg/attarchive/


• html


• AR Faces Databases. Available online:http://www2.ece.ohio state.edu/~aleix/ARdatabase.html


• The Yale Database. Available online:http://vision.ucsd.edu/content/yale-face-database.


• The FERET Face Database. Available online:http://www.it1.nist.gov/iad/humanid/feret/


• Samaria, F.; Harter, A.C. Parameterisation of a stochastic model for human face identification. In Proceedings of the Second IEEE Workshop Applications of Computer Vision, Sarasota, FL, USA, 5–7 December 1994.


• Le, T.H.; Bui, L. Face recognition based on SVM and 2DPCA.Int. J. Signal Process. Image Process. Pattern


• 2011, 4, 85–94.


• Deniz, O.; Castrillon, M.; Hernandez, M. Face recognition using independent component analysis and


• Support vector machines, Pattern Recognition Letters, 2003, 24, 2153–2157.


• Turk, A.; Pentland, A.P. Face recognition using eigenfaces. In Proceedings of the IEEE Conference on


• Computer Vision and Pattern Recognition, Maui, HI, USA, 3–6 June 1991; pp. 586–591.


• Jian, Y.; Zhang, D.; Frangi, A.; Yang, J.Y. Two-dimensional PCA: A new approach to appearance-based face representation and recognition.IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26, 131–137.


• Bartlett, M.S.; Movellan, J.R.; Sejnowski, T.J. Face recognition by independent component analysis.IEEE Trans. Neural Netw.2002, 13, 1450–1464.


• Chihaoui, M.; Elkefi, A.; Bellil, W.; Amar, C.B. A novel face recognition recognition system using HMM-LBP. Int. J. Comput. Sci. Inf. Secur. 2016, 14, 308–316.


• Kepenekci, B. Face Recognition Using Gabor Wavelet Transform. Ph.D. Thesis, the Middle East Technical University, Ankara, Turkey, 2001.


• Le, T.H.; Bui, L. Face recognition based on SVM and 2DPCA.Int. J. Signal Process. Image Process. Pattern


• 2011, 4, 85–94.


• https://www2.imm.dtu.dk/~aam/datasets/datasets.html


• http://www.anefian.com/research/face_reco.htm


• http://www.vision.caltech.edu/Image_Datasets/Caltech_10K_Faces/


• http://www.face-rec.org/databases/


• http://arma.sourceforge.net/chokepoint/


• http://www.kasrl.org/jaffe.html


• http://www.consortium.ri.cmu.edu/ckagree/


• http://iab-rubric.org/resources/newborns.html


• http://wwwprima.inrialpes.fr/perso/Gourier/Faces/HPDatabase.html


• http://cswww.essex.ac.uk/mv/allfaces/index.html


• https://facedetection.com/datasets/