LIGHTWEIGHT DENSE-BASED CNN MODEL FOR FACIAL EXPRESSION RECOGNITION AND APPLICATION FOR ONLINE LEARNING EVALUATION

Authors

  • Dương Thăng Long*, Đỗ Thị Thu Hà†, Trần Văn Nam‡

Keywords:

Convolutional neural network, DenseNet architecture, facial expressions recognition, online learning management systems

Abstract

Convolutional neural networks (CNN) for facial emotion recognition (FER) are being studied by many authors with very positive results and successful applications. State- of-the-art CNN models with diverse architectures such as VGG, ResNet, Xception, EfficientNet, and DenseNet and their variations are widely applied to many image recognition problems, including FER. However, these models have considerable complexity for some real-world applications with limited computational resources. This paper proposes a lightweight CNN model based on DenseNet architectures with moderate complexity but still ensures quality and efficiency for facial emotion recognition. Then, it is designed to be integrated into LMS for recording and evaluating online learning activities. The proposed model is tested to assess some popular datasets; the results show that the model is effective and can be used in practice.

References

[1]. D.T.Long, “A Facial Expressions Recognition Method Using Residual Network Architecture for Online Learning Evaluation,” Journal of Advanced Computational Intelligence and Intelligent Informatics, tập 25, số 6, pp. 1-10, 2021.

[2]. W.Deng và S. Li, “Deep Facial Expression Recognition: A Survey,” IEEE Transactions on Affective Computing, tập 13, pp. 1195- 1215, 2022.

[3]. M.Wang và W.Deng, “Deep Face Recognition: A Survey,” Neurocomputing, tập 429, pp. 215-244, 2021.

[4]. S.-C. Lai, C.-Y. Chen và J.-H. Li,“Efficient Recognition of Facial Expression with Lightweight Octave Convolutional Neural Network,” Journal of Imaging Science and Technology, pp. 040402.1-9, 2022.

[5]. A. Greco, N. Strisciuglio, M. Vento và

V. Vigilante, “Benchmarking deep networks for facial emotion recognition in the wild,” Multimedia Tools and Applications, pp. https://doi.org/10.1007/s11042-022-12790-7, 2022.

[6]. M. Tan và Q. V. Le, “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks,” Proceedings of the 36th International Conference on Machine Learning, pp. 6105-6114, 2019.

[7]. G. Huang, Z. Liu, L. V. D. Maaten và K. Q. Weinberger, “Densely Connected Convolutional Networks,” IEEE Conference on Computer Vision and Pattern Recognition(CVPR), số ISSN:1063-6919, pp. 1-9, 2018.

[8]. G. Zhao, H. Yang và M. Yu, “Expression Recognition Method Based on a Lightweight Convolutional Neural Network,” IEEE Access, tập 18, pp. 38528 - 38537, 2020.

[9]. R. R. Devaram và A. Cesta, “LEMON: A Lightweight Facial Emotion Recognition System for Assistive Robotics Based on Dilated Residual Convolutional Neural Networks,” Sensors, tập 22, số 3366, pp. 1-20,2022.

[10]. D.T.Long, “A Lightweight Face Recognition Model Using Convolutional Neural Network for Monitoring Students in E-Learning,” I.J. Modern Education and Computer Science, tập 6, pp. 16-28, 2020.

[11]. N. Zhou, R. Liang và W. Shi, “A Lightweight Convolutional Neural Network for Real-Time Facial Expression Detection,” IEEE Access, tập 9, pp. 5573 - 5584, 2020.

[12]. P. N. R. Bodavarapu và P. Srinivas, “An Optimized Neural Network Model for Facial Expression Recognition over Traditional Deep Neural Networks,” International Journal of Advanced Computer Science and Applications, tập 12, số 7, pp. 443-451, 2021.

[13]. Y. Nan, J. Ju, Q. Hua, H. Zhang và B. Wang, “A-MobileNet: An approach of facial expression recognition,” Alexandria Engineering Journal, tập 61, p. 4435–4444, 2022.

Loading...