Masked Face Recognition Using Natural Language Processing And Convolution Neural Network: A Systematic Review | IJEEE β Volume 9Β -Issue 3 | IJEEE-V9I3P2
International Journal of Electrical Engineering and Ethics
ISSN: 2456-9771 | PeerβReviewed Open Access Journal
Volume 9, Issue 2
|
Published:
Author
Sweksha Soni, Aman Shukla, Krashan Kumar Chaudhari, Utkrishat Dusad
Abstract
Masked face recognition (MFR) has gained significant importance in recent years due to the widespread adoption of face masks driven by global health crises and increasing security requirements. Traditional face recognition systems often fail to perform effectively when key facial features are occluded, creating a need for more robust and adaptive solutions. In response, numerous deep learning (DL) and machine learning approachesβparticularly those based on convolution neural networks (CNNs)βhave been developed to improve recognition accuracy under masked conditions. These models are widely applied in areas such as surveillance, secure authentication, and public safety, where real-time performance is essential. This paper presents a systematic review of recent MFR techniques, focusing on deep network architectures, feature extraction strategies, and model optimization methods. It also examines commonly used tools and frameworks, along with benchmark datasets and evaluation metrics employed in existing studies. A structured methodology is adopted to ensure a transparent and reproducible selection of relevant literature. Furthermore, this review categorizes current approaches, identifies key challenges such as occlusion handling, dataset limitations, and real-time constraints, and outlines potential directions for future research aimed at developing more efficient and reliable masked face recognition systems.
Keywords
Masked Face Recognition, Deep Learning, CNN, Occlusion Handling, Feature Extraction, Surveillance Systems, Real-time Recognition.Conclusion
Overall, this work highlights the importance of robust and efficient deep learning models for reliable masked face
recognition. The proposed approach achieves strong accuracy while maintaining real-time performance, making it applicable for modern security and authentication systems. Future improvements may focus on enhancing model generalization, reducing computational cost, and integrating larger diverse datasets to further improve performance in unconstrained environments.
The proposed system demonstrates that CNN-based architectures are highly effective in extracting meaningful facial features even when partial occlusion is present. By using real-time image processing through a webcam, the model successfully detects faces and classifies them as masked or unmasked with high accuracy. The system also performs well under varying conditions such as different face angles and multiple face detection in a single frame, making it suitable for practical applications like surveillance and access control.
From the literature analysis, it is evident that deep learning models outperform traditional machine learning approaches in masked face recognition tasks. Techniques such as transfer learning, lightweight CNN architectures, and attention-based mechanisms have further improved system performance. However, challenges such as limited real- world datasets, variations in mask types, and computational efficiency still remain significant obstacles.
References
[1]Z. Zhang, B. Bowes, The future of artificial intelligence (AI) and machine learn
ing (ML) in landscape design: a case study in coastal Virginia, USA, J. Digital
Landscape Arch. 2019 (4) (2019) 2β9, https://doi .org /10
.14627 /537663001.
[2]S.Y. Kung, M.W. Mak, Machine learning for multimodality genomic signal pro
cessing, IEEE Signal Process. Mag. 23 (3) (2006) 117β121, https://doi .org /10 .
1109 /MSP.2006 .1628886.
[3]D. Duarte, F. Nex, N. Kerle, G. Vosselman, Satellite image classification of build
ing damages using airborne and satellite image samples in a deep learning
approach, in: ISPRS Annals of the Photogrammetry,
Remote Sensing and Spa
tial Information Sciences, vol. 4(2), 2018, pp. 89β96.
[4]P. Gupta, N. Saxena, M. Sharma, J. Tripathi, Deep neural network for human
face recognition, Int. J. Eng. Manufact. 8(1) (2018) 63β71, https://doi .org /10 .
5815 /ijem .2018 .01.06.
[5]K.J. Bhojane, S.S. Thorat, A review of face recognition based car ignition and
security system, Int. Res. J. Eng. Technol. 05 (01) (2018) 532β533.
[6]S. Mahmud, J. Kim, An Automated System to Limit COVID-19 Using Facial Mask
Detection in Smart City Network, 2021, pp. 11β15.
[7]Sushovan Chaudhury, Manik Rakhra, Naz Memon, Kartik Sau,
Melkamu Teshome Ayana, Breast cancer calcifications: identification using
anovel segmentation approach, Comput. Math. Methods Med. 2021 (2021)
9905808, https://doi .org /10 .1155 /2021 /9905808, 13 pages.
Fig.4.2.
[8]J.T. Sunny, S.M. George, Applications and challenges of human activity recogni
tion using sensors in a smart environment, 2(04) (2015) 50β 57.
[9]M. Rakhra, R. Singh, Economic and social survey on renting and hiring of agri
cultural equipment of farmers in Punjab, in: 2021 9th International Conference
on Reliability, Infocom Technologies and Optimization (Trends and Future Di
rections) (ICRITO), 2021, pp. 1β5.
[10]D. Bhamare, P. Suryawanshi, Review on reliable pattern recognition with ma
chine learning techniques, Fuzzy Inf. Eng. 10 (1) (2019) 1β 16, https://doi .org /
10 .1080 /16168658 .2019 .1611030.
[11]V. Vinitha, V. Velantina, COVID-19 Facemask Detection with Deep Learning and
Computer Vision, 2020.
[12]R. Bhuiyan, A Deep Learning Based Assistive System to Classify COVID-19 Face
Mask for Human Safety with YOLOv3, 2020.
[13]T. Meenpal, Facial mask detection using semantic segmentation, in: 2019 4th
International Conference on Computing, Communications and Security (ICCCS)
(October), 2019, pp. 1β5.
[14]https://drive .google .com /drive /folders
/1Dm2sV8UrMd6OKzjVk W859WznhfSXFZF8.
[15]K. Grolinger, M. Hayes, W.A. Higashino, A. LβHeureux, D.S. Allison, M.A.M.
Capretz, Challenges for MapReduce in big data, in: Proc. IEEE World Congr.
Services (SERVICES), Jun. 2014, pp. 182β189.
[16]M.M. Najafabadi, F. Villanustre, T.M. Khoshgoftaar,
N. Seliya, R. Wald, E.
Muharemagic, Deep learning applications and challenges in big data analytics,
Big Data 2(1) (Feb. 2015) 1.
[17]K.F. Tasneem, et al., Affordable black box: a smart accident detection system for
cars, in: 2021 9th International Conference on Reliability,
Infocom Technologies
and Optimization (Trends and Future Directions) (ICRITO), 2021, pp. 1β5.
[18]Al-Nabulsi, J.; Turab, N.; Owida, H.A.; Al-Naami, B.; De Fazio, R.; Visconti, P. IoT solutions and AI-based frameworks for
masked-face and face recognition to fight the COVID-19 pandemic. Sensors 2023, 23, 7193. [CrossRef] [PubMed]
[19]Zhang, L.; Verma, B.; Tjondronegoro, D.; Chandran,
V. Facial expression analysis under partial occlusion: A survey. ACM Comput.
Surv. 2018, 51, 1β49. [CrossRef]
20. Lahasan, B.; Lutfi, S.L.; San-Segundo, R. A survey on techniques to handle face recognition challenges: Occlusion, single sample
per subject and expression. Artif. Intell. Rev. 2019, 52, 949β 979. [CrossRef]
[21]Zeng, D.; Veldhuis, R.; Spreeuwers, L. A survey of face recognition techniques under occlusion. IET Biom. 2021, 10, 581β606.
[CrossRef]
[22]Hasan, M.R.; Guest, R.; Deravi, F. Presentation-level privacy protection techniques for automated face recognitionβA survey.
ACMComput. Surv. 2023, 55, 1β27. [CrossRef]
[23]Sharma, R.; Ross, A. Periocular biometrics and its relevance to partially masked faces: A survey. Comput. Vis. Image Underst.
2023, 226, 103583. [CrossRef]
[24]
Duong,H.T.; Nguyen-Thi, T.A. A review: Preprocessing techniques and data augmentation for sentiment analysis. Comput. Soc.
Netw. 2021, 8, 1. [CrossRef]
[25]Maharana, K.; Mondal, S.; Nemade, B. A review: Data pre-processing and data augmentation techniques. Glob. Transit. Proc.
2022, 3, 91β99. [CrossRef]
[26]Liu, X.; Zou, Y.; Kuang, H.; Ma, X. Face image age estimation based on data augmentation and lightweight convolutional neural
network. Symmetry 2020, 12, 146. [CrossRef]
[27]Charoqdouz, E.; Hassanpour, H. Feature extraction from several angular faces using a deep learning based fusion technique for
face recognition. Int. J. Eng. Trans. B Appl. 2023, 36, 1548β 1555. [CrossRef]
[28]Riaz, Z.; Mayer, C.; Beetz, M.; Radig, B. Model based analysis of face images for facial feature extraction. In Proceedings of the
Computer Analysis of Images and Patterns: 13th International Conference, CAIP 2009, MΓΌnster, Germany, 2β4 September 2009;
Springer: Berlin/Heidelberg, Germany, 2009; pp. 99β106.
[29]Feihong, L.; Hang, C.; Kang, L.; Qiliang, D.; Jian, Z.; Kaipeng, Z.; Hong, H. Toward high-quality face-mask occluded restoration.
ACMTrans. Multimed. Comput. Commun. Appl. 2023, 19, 1β23. [CrossRef]
[30]Shukla, R.K.; Tiwari, A.K. Masked face recognition using MobileNet V2 with transfer learning. Comput. Syst. Sci. Eng.
2023, 45, 293β309. [CrossRef]