International Journal of Computer Science & Network Security

International Journal of Computer Science & Network Security (국제컴퓨터통신보호논문지학회)
권호 표지
DOI QR코드

DOI QR Code

FRS-OCC: Face Recognition System for Surveillance Based on Occlusion Invariant Technique

  • Abbas, Qaisar (College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU))
  • Received : 2021.08.05
  • Published : 2021.08.30
Download PDF
⟨ Previous Next ⟩

Abstract

Automated face recognition in a runtime environment is gaining more and more important in the fields of surveillance and urban security. This is a difficult task keeping in mind the constantly volatile image landscape with varying features and attributes. For a system to be beneficial in industrial settings, it is pertinent that its efficiency isn't compromised when running on roads, intersections, and busy streets. However, recognition in such uncontrolled circumstances is a major problem in real-life applications. In this paper, the main problem of face recognition in which full face is not visible (Occlusion). This is a common occurrence as any person can change his features by wearing a scarf, sunglass or by merely growing a mustache or beard. Such types of discrepancies in facial appearance are frequently stumbled upon in an uncontrolled circumstance and possibly will be a reason to the security systems which are based upon face recognition. These types of variations are very common in a real-life environment. It has been analyzed that it has been studied less in literature but now researchers have a major focus on this type of variation. Existing state-of-the-art techniques suffer from several limitations. Most significant amongst them are low level of usability and poor response time in case of any calamity. In this paper, an improved face recognition system is developed to solve the problem of occlusion known as FRS-OCC. To build the FRS-OCC system, the color and texture features are used and then an incremental learning algorithm (Learn++) to select more informative features. Afterward, the trained stack-based autoencoder (SAE) deep learning algorithm is used to recognize a human face. Overall, the FRS-OCC system is used to introduce such algorithms which enhance the response time to guarantee a benchmark quality of service in any situation. To test and evaluate the performance of the proposed FRS-OCC system, the AR face dataset is utilized. On average, the FRS-OCC system is outperformed and achieved SE of 98.82%, SP of 98.49%, AC of 98.76% and AUC of 0.9995 compared to other state-of-the-art methods. The obtained results indicate that the FRS-OCC system can be used in any surveillance application.

Keywords

Acknowledgement

The author would like to express their cordial thanks to the deanship of scientific research at Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia.

References

  1. M. Martinez, "Recognizing Imprecisely Localized, Partially Occluded and Expression Variant Faces from a Single Sample per Class", in IEEE Trans. on PAMI, V.24, p748-763, 2002 https://doi.org/10.1109/TPAMI.2002.1008382
  2. P. Quintiliano, A. N. Santa-Rosa, R. Guadagnin "Face recognition based on eigenfeatures", Proc. SPIE Vol. 4550, p. 140-145, Image Extraction, Segmentation, and Recognition, 2001
  3. M. A. Turk, A. P. Pentland, "Face recognition using eigenfaces", Proceedings of the IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 586-591, Hawaii 1991.
  4. J. Kim, Y. Sung, S.M. Yoon and B.G. Park, "A New Video Surveillance System Employing Occluded Face Detection", Proc. of the 18th int. conf. on Innovations in Applied Artificial Intelligence, Italy, pp. 65-68, 2005.
  5. S. M. Yoon and S. C. Kee, "Detection of Partially Occluded Face using Support Vector Machines", IAPR Workshop on Machine Vision Applications, Japan, pp. 546-549, 2002.
  6. K. Hotta, "A Robust Face Detector Under Partial Occlusion", Int. Conf. on Image Processing, 2004 (ICIP '04), pp. 597-600, 2004.
  7. T. Kurita, M. Pic and T. Takahashi, "Recognition and Detection of Occluded Faces by a Neural Network Classifier with Recursive Data Reconstruction", Proc. of the IEEE Conf. on Advanced Video and Signal Based Surveillance (AVSS'03), pp. 53-58, 2003.
  8. M. A. Mottaleb and A. Elgammal. Face Detection in complex environments from color images. IEEE ICIP: 622-626, 1999.
  9. J. Ross and Beveridge et. al. A nonparametric statistical comparison of principal component and linear discriminant subspaces for face recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition: 535 - 542, 2001.
  10. A.M. Martinez and R. Benavente, "The AR Face Database", CVC Technical Report 24, 1998.
  11. A.M. Martinez, "Recognition of Partially Occluded and/or Imprecisely Localized Faces using a Probabilistic Approach", CVPR, Vol. 1, pp. 712-717, 2000. MIT face database, ftp://whitechapel.media.mit.edu/pub/images/
  12. A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, "From few to many: Illumination cone models for recognition under variable lighting and pose", IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no.6, pp. 643-660, 2001 https://doi.org/10.1109/34.927464
  13. Abate A., Nappi M., Riccio D., and Tucci M., "Occluded Face Recognition by Means of the IFS," in Proceedings of the 2nd International Conference Image Analysis and Recognition, Berlin, pp. 1073-1080, 2005.
  14. Aleix M., "Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample Per Class," IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 24, no. 6, pp. 748-763, 2002. https://doi.org/10.1109/TPAMI.2002.1008382
  15. Amirhosein N., Esam A., and Majid A., "Illumination Invariant Feature Extraction and Mutual-Information-Based Local Matching for Face Recognition under Illumination Variation and Occlusion," Pattern Recognition, vol. 44, no. 10-11, pp. 2576-2587, 2011. https://doi.org/10.1016/j.patcog.2011.03.012
  16. Baudat G. and Anouar F., "Generalized Discriminant Analysis using a Kernel Approach," Neural Computation, vol. 12, no. 10, pp. 2385-2404, 2000. https://doi.org/10.1162/08997660030001498
  17. Sharma, M., Prakash, S., & Gupta, P. (2013). An efficient partial occluded face recognition system. Neurocomputing, 116, 231-241. https://doi.org/10.1016/j.neucom.2011.12.063
  18. Li, X. X., Dai, D. Q., Zhang, X. F., & Ren, C. X. (2013). Structured sparse error coding for face recognition with occlusion. IEEE transactions on image processing, 22(5), 1889-1900. https://doi.org/10.1109/TIP.2013.2237920
  19. Ou, W., You, X., Tao, D., Zhang, P., Tang, Y., & Zhu, Z. (2014). Robust face recognition via occlusion dictionary learning. Pattern Recognition, 47(4), 1559-1572. https://doi.org/10.1016/j.patcog.2013.10.017
  20. Chen W., Yuen P., Huang J., and Dai D., "Kernel Machine-Based One-Parameter Regularized Fisher Discriminant Method for Face Recognition," IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 35, no. 4, pp. 659-669, 2005. https://doi.org/10.1109/TSMCB.2005.844596
  21. Yu, Y. F., Dai, D. Q., Ren, C. X., & Huang, K. K. (2017). Discriminative multi-scale sparse coding for single-sample face recognition with occlusion. Pattern Recognition, 66, 302-312. https://doi.org/10.1016/j.patcog.2017.01.021
  22. Wu, C. Y., & Ding, J. J. (2018). Occluded face recognition using low-rank regression with generalized gradient direction. Pattern Recognition, 80, 256-268. https://doi.org/10.1016/j.patcog.2018.03.016
  23. Long, Y., Zhu, F., Shao, L., & Han, J. (2018). Face recognition with a small occluded training set using spatial and statistical pooling. Information Sciences, 430, 634-644. https://doi.org/10.1016/j.ins.2017.10.042
  24. Zheng, W., Gou, C., & Wang, F. Y. (2020). A novel approach inspired by optic nerve characteristics for few-shot occluded face recognition. Neurocomputing, 376, 25-41. https://doi.org/10.1016/j.neucom.2019.09.045
  25. Kumar, S., & Singh, S. K. (2020). Occluded Thermal Face Recognition Using Bag of CNN ($ Bo $ CNN). IEEE Signal Processing Letters, 27, 975-979. https://doi.org/10.1109/LSP.2020.2996429
  26. Qiu, H., Gong, D., Li, Z., Liu, W., & Tao, D. (2021). End2End Occluded Face Recognition by Masking Corrupted Features. IEEE Transactions on Pattern Analysis and Machine Intelligence.
  27. Bommidi, K., & Sundaramurthy, S. (2021). A compressed string matching algorithm for face recognition with partial occlusion. Multimedia Systems, 27(2), 191-203. https://doi.org/10.1007/s00530-020-00727-9
  28. Koc, M. (2021). A novel partition selection method for modular face recognition approaches on occlusion problem. Machine Vision and Applications, 32(1), 1-11. https://doi.org/10.1007/s00138-020-01119-9