MULTI-TASK CNN MODEL FOR FACE AND FACIAL EXPRESSION RECOGNITION AND APPLICATION FOR MONITORING ONLINE LEARNING

Authors

  • Dương Thăng Long, Chu Minh, Phí Quốc Chính

Keywords:

Multi-task convolutional neural network, face recognition, facial expressions recognition, online learning management systems

Abstract

The online learning management system (LMS) is being more and more widely developed and contributes to improving the quality of training at educational institutions. However, at present, there are few systems with enhanced monitoring and support for learners based on modern technologies. Especially, the application of this facial recognition and facial expression technology makes the tracking and monitoring of learners highly automated and timely supported. By using multi-tasking convolutional neural networks, this study proposes such a network model to perform two tasks of face recognition and facial expression recognition. The model is tested on published data sets including CK+, OuluCASIA and our collected data. The experimental results are significant in comparison with some modern architectures while the model size is simpler. Based on the proposed model, we design an integrated proposed model with the online LMS in the direction of open connection to increase the monitoring and tracking learning activities, therefore, it can give warnings as well as notify teachers and learners to adjust teaching and learning activities to improve training quality.

References

[1]. Duong Thang Long, A [ghtweight Face Recognition Model Using Convolutional Neural Network for Monitoring Students in E-Learning, I.J. Modern Education and Computer Science, vol.6, pp.16-28, 2020.

[2]. Francisco D. Guillén-Gámez, Facial authentication software for the identification and verification of students who use virtual learning platform (LMS), Advances in Educational Technology and Psychology, 1: 1-8 Clausius Scientific Press, Canada, 2017.

[3]. Ayham Fayyoumi1 and Anis Zarrad, Novel Solution Based on Face Recognition to Address Identity Theft and Cheating in Online Examination Systems, Advances in Internet of Things, 2014, 4, 5-12.

[4]. Ekberjan Derman1 and Albert Ali Salah, Continuous Real-Time Vehicle Driver Authentication Using Convolutional Neural Network Based Face Recognition, 3th IEEE International Conference on Automatic Face & Gesture Recognition (FG), 2018.

[5]. Shan [ and Weihong Deng, Deep Facial Expression Recognition - A Survey, IEEE Transactions on Affective Computing, 2020.

[6]. Vijayan K. Asari and et al., A State-of- the-Art Survey on Deep Learning Theory and Architectures, Electronics, 8, 292, 2019.

[7]. G. Zhao, X. Huang, and et al., Facial expression recognition from near-infrared videos, Image and Vision Computing, 29(9):607–619, 2011.

[8]. I.Michael Revina and W.R. Sam Emmanuel, A Survey on Human Face Expression Recognition Techniques, https:// doi.org/10.1016/ j.jksuci.2018.09.002, 2018.

[9]. Hanzi Wang et al., Deep Multi-task Multi-label CNN for Effective Facial Attribute Classification, https://arxiv.org/ abs/2002.03683, 2020.

[10]. Haoran Ma et al., A multi‐task CNN learning model for taxonomic assignment of human viruses, BMC Bioinformatics 22:194, 2021.

[11]. Zhaoying [u et al., A Multi-Task CNN for Maritime Target Detection, IEEE Signal Processing Letters, Vol. 28, 2021.

[12]. Dinh Viet Sang and Le Tran Bao Cuong, Effective Deep Multi-source Multi-task Learning Frameworks for Smile Detection, Emotion Recognition and Gender Classification, Informatica, vol.42, pp.345–356, 2018.

[13]. Diederik P. Kingma and Jimmy Lei Ba, Adam-A Method for Stochastic Optimization, Published as a conference paper at ICLR 2015.

[14]. Xavier Glorot and Yoshua Bengio, Understanding the difficulty of training deep feedforward neural networks, Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS), 2010.

[15]. Patrick Lucey et al., The Extended Cohn- Kanade Dataset (CK+ dataset), IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, 2010.

[16]. Duong Thang Long, A Facial Expressions Recognition Method Using Residual Network Architecture for Online Learning Evaluation, Journal of Advanced Computational Intelligence Informatics, Vol.25 No.6, 2021.

[17]. Chunrui Han and et al., Face Recognition with Contrastive Convolution, ECCV, DOI:10.1007/978-3-030-01240-3_8, 2018.

[18]. Kaiming He et al., Identity Mappings in Deep Residual Networks, arXiv:1603.05027v3 [cs.CV] 25 Jul 2016.

Downloads

Issue

Number 91