RESCNN: A Deep Learning Approach for Unmasking Face Mask
Keywords:COVID-19, Face Mask, Detection, Face Unmasking, CNN, Residual Learning.
Due to outbreak of COVID-19 pandemic, the trend of wearing mask is rising all over the world. Before such pandemic people wear mask only to protect themselves from pollution. While other people are self-conscious about their looks, they hide their emotions from the public by hiding their faces. But in current scenario, after pandemic, it is compulsory to wear mask everywhere as researchers and doctors have proved that wearing face masks works on impeding COVID-19 transmission. Nowadays, all attendance system or surveillance systems, etc. are integrated with AI technology in which face recognition is considered as input variable. So, there is need to determine all facial landmarks to recognize an individual. In this research work, Residual Convolution Neural Network (ResCNN), network is designed and simulated which unmasks the face mask present on face and restore mask area and recognize an individual. The result analysis is performed in three different cases or scenario, one normal frontal facial region with mask, in another case the masked face is tilted and in third case the noisy masked face is taken as input. The noise in image occurs due to many physical conditions. The dataset for training of ResCNN is prepared by masking facial images taken from CelebA dataset and MFR datasets to prove the efficiency of the proposed model.
Kimball A, Hatfield KM, Arons M, James A, Taylor J, Spicer K, et al., “Public Health – Seattle & King County; CDC COVID-19 Investigation Team. Asymptomatic and presymptomatic SARS-CoV-2 infections in residents of a long-term care skilled nursing facility - King County”, MMWR Morb Mortal Wkly Rep 2020;69:377–381.
Radonovich LJ Jr, Simberkoff MS, Bessesen MT, Brown AC, Cummings DAT, Gaydos CA, “ResPECT Investigators. N95 respirators vs medical masks for preventing influenza among health care personnel: a randomized clinical trial”, JAMA 2019;322:824–833.
Zou L, Ruan F, Huang M, Liang L, Huang H, Hong Z, “SARS-CoV-2 viral load in upper respiratory specimens of infected patients”, N Engl J Med 2020;382:1177–1179.
Timo Ahonen and Matti Pietikainen, “Face description using Local Binary Patterns: Application to Face Recognition” inIEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 28, No 12, 2006.
N. Ud Din, K. Javed, S. Bae and J. Yi, "A Novel GAN-Based Network for Unmasking of Masked Face," in IEEE Access, vol. 8, pp. 44276-44287, 2020.
G. Dong, W. Huang, W. A. P. Smith, and P. Ren, ‘‘A shadow constrained conditional generative adversarial net for SRTM data restoration,’’ Remote Sens. Environ., vol. 237, Feb. 2020, Art. no. 111602.
S. Li et al., "Multi-angle Head Pose Classification when Wearing the Mask for Face Recognition under the COVID-19 Coronavirus Epidemic," 2020 International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS), Shenzhen, China, 2020, pp. 1-5.
S. A. Hussain, A.S.A.A. Balushi, A real time face emotion classification and recognition using deep learning model, J. Phys.: Conf. Ser. 1432 (2020) 012087, doi: 10.1088/1742-6596/1432/1/012087
M.K.J. Khan, N. Ud Din, S. Bae, J. Yi, Interactive removal of microphone object in facial images, Electronics 8 (10) (2019) , Art. no. 10, doi: 10.3390/ electronics8101115.
How to Cite
Copyright (c) 2021 Bhusra Fatima, Arun Kumar Jhapate
This work is licensed under a Creative Commons Attribution 4.0 International License.
IJOSCIENCE follows an Open Journal Access policy. Authors retain the copyright of the original work and grant the rights of publication to the publisher with the work simultaneously licensed under a Creative Commons CC BY License that allows others to distribute, remix, adapt, and build upon your work, even commercially, as long as they credit you for the original creation. Authors are permitted to post their work in institutional repositories, social media or other platforms.
Under the following terms:
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.