RESCNN: A Deep Learning Approach for Unmasking Face Mask


  • Bhusra Fatima M.Tech Scholar, Sagar Institute of Research & Technology, Bhopal, M. P, India
  • Arun Kumar Jhapate Professor, Sagar Institute of Research & Technology, Bhopal, M. P, India



COVID-19, Face Mask, Detection, Face Unmasking, CNN, Residual Learning.


Due to outbreak of COVID-19 pandemic, the trend of wearing mask is rising all over the world. Before such pandemic people wear mask only to protect themselves from pollution. While other people are self-conscious about their looks, they hide their emotions from the public by hiding their faces. But in current scenario, after pandemic, it is compulsory to wear mask everywhere as researchers and doctors have proved that wearing face masks works on impeding COVID-19 transmission. Nowadays, all attendance system or surveillance systems, etc. are integrated with AI technology in which face recognition is considered as input variable. So, there is need to determine all facial landmarks to recognize an individual. In this research work, Residual Convolution Neural Network (ResCNN), network is designed and simulated which unmasks the face mask present on face and restore mask area and recognize an individual. The result analysis is performed in three different cases or scenario, one normal frontal facial region with mask, in another case the masked face is tilted and in third case the noisy masked face is taken as input. The noise in image occurs due to many physical conditions. The dataset for training of ResCNN is prepared by masking facial images taken from CelebA dataset and MFR datasets to prove the efficiency of the proposed model.


Download data is not yet available.


Kimball A, Hatfield KM, Arons M, James A, Taylor J, Spicer K, et al., “Public Health – Seattle & King County; CDC COVID-19 Investigation Team. Asymptomatic and presymptomatic SARS-CoV-2 infections in residents of a long-term care skilled nursing facility - King County”, MMWR Morb Mortal Wkly Rep 2020;69:377–381.

Radonovich LJ Jr, Simberkoff MS, Bessesen MT, Brown AC, Cummings DAT, Gaydos CA, “ResPECT Investigators. N95 respirators vs medical masks for preventing influenza among health care personnel: a randomized clinical trial”, JAMA 2019;322:824–833.

Zou L, Ruan F, Huang M, Liang L, Huang H, Hong Z, “SARS-CoV-2 viral load in upper respiratory specimens of infected patients”, N Engl J Med 2020;382:1177–1179.

Timo Ahonen and Matti Pietikainen, “Face description using Local Binary Patterns: Application to Face Recognition” inIEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 28, No 12, 2006.

N. Ud Din, K. Javed, S. Bae and J. Yi, "A Novel GAN-Based Network for Unmasking of Masked Face," in IEEE Access, vol. 8, pp. 44276-44287, 2020.

G. Dong, W. Huang, W. A. P. Smith, and P. Ren, ‘‘A shadow constrained conditional generative adversarial net for SRTM data restoration,’’ Remote Sens. Environ., vol. 237, Feb. 2020, Art. no. 111602.

S. Li et al., "Multi-angle Head Pose Classification when Wearing the Mask for Face Recognition under the COVID-19 Coronavirus Epidemic," 2020 International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS), Shenzhen, China, 2020, pp. 1-5.

S. A. Hussain, A.S.A.A. Balushi, A real time face emotion classification and recognition using deep learning model, J. Phys.: Conf. Ser. 1432 (2020) 012087, doi: 10.1088/1742-6596/1432/1/012087

M.K.J. Khan, N. Ud Din, S. Bae, J. Yi, Interactive removal of microphone object in facial images, Electronics 8 (10) (2019) , Art. no. 10, doi: 10.3390/ electronics8101115.




How to Cite

Fatima, B. ., & Jhapate, A. K. (2021). RESCNN: A Deep Learning Approach for Unmasking Face Mask. SMART MOVES JOURNAL IJOSCIENCE, 7(1), 49–55.