The Journal of the Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회논문지)

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Design and Implementation of Personal Information Identification and Masking System Based on Image Recognition

이미지 인식 기반 향상된 개인정보 식별 및 마스킹 시스템 설계 및 구현

  • 박석천 (가천대학교 컴퓨터공학과)
  • Received : 2017.07.31
  • Accepted : 2017.10.13
  • Published : 2017.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, with the development of ICT technology such as cloud and mobile, image utilization through social networks is increasing rapidly. These images contain personal information, and personal information leakage accidents may occur. As a result, studies are underway to recognize and mask personal information in images. However, optical character recognition, which recognizes personal information in images, varies greatly depending on brightness, contrast, and distortion, and Korean recognition is insufficient. Therefore, in this paper, we design and implement a personal information identification and masking system based on image recognition through deep learning application using CNN algorithm based on optical character recognition method. Also, the proposed system and optical character recognition compares and evaluates the recognition rate of personal information on the same image and measures the face recognition rate of the proposed system. Test results show that the recognition rate of personal information in the proposed system is 32.7% higher than that of optical character recognition and the face recognition rate is 86.6%.

최근 클라우드, 모바일 등 ICT 기술의 발전으로 소셜 네트워크를 통한 이미지 활용이 급증하고 있다. 이러한 이미지는 개인정보가 포함되어 있어, 개인정보 유출 사고가 발생될 수 있다. 이에 이미지에서 개인정보를 인식하고 마스킹하는 연구가 진행되고 있다. 그러나 기존 이미지에서 개인정보를 인식 하는 방법인 광학 문자 인식은 이미지의 밝기, 명암, 왜곡에 따라 인식률의 변화가 심하여 한글 인식이 미흡한 문제가 있다. 따라서 본 논문에서는 광학 문자 인식 방법을 기반으로 CNN 알고리즘에 딥러닝을 적용하여 이미지 인식 기반 향상된 개인정보 식별 및 마스킹 시스템을 설계 및 구현하였다. 또한 구현된 제안 시스템을 동일한 이미지를 가지고 광학 문자 인식과 개인정보 인식률을 비교평가를 진행하고, 제안 시스템의 얼굴 인식률을 측정하였다. 테스트 결과 제안 시스템의 개인정보 인식률은 광학 문자인식에 비해 32.7% 향상되었으며 얼굴 인식률은 86.6%로 확인되었다.

Keywords

References

  1. Mi-Gyung Lee, Jin-Wan Park, "An Study on Usability Evaluation of Image based SNS," Journal of The Korea Contents Association, The Korea Contens Society, Vol. 16, No. 8, pp. 508-516, Aug 2016. DOI: https://doi.org/10.5392/JKCA.2016.16.08.508.
  2. Jeong-Hyun Cho, Cheol-Woong Ahn, "Auto Detection System of personal Information based on Images and Document Analysis," The Journal of Institute of Internet, Broadcasting and Communication, Vol. 15, No. 5, pp. 183-192, Oct 2015. DOI: https://doi.org/10.7236/JIIBC.2015.15.5.183.
  3. Joung-Hae Bang, So-Ra Kang, Min-Sun Kim, "The Study of Factors to Affect on Users' Self-disclosure in Social Networking Services" Journal of the Korea Academia-Industrial cooperation Society, Vol. 17, No. 8, pp. 69-76, Aug 2016. DOI: https://doi.org/10.7236/JIIBC.2014.14.6.267.
  4. Bo Kim, Jong-In Lim, Yong-Hyun Jo, "Privacy Situation and Countermeasures of Financial Apps based on the Android operating system," The Journal of Institute of Internet, Broadcasting and Communication, Vol. 14, No. 6, pp. 267-272, Dec 2014. DOI: https://doi.org/10.7236/JIIBC.2014.14.6.267.
  5. Jae-wan Kim, Sang-tae Kim, Jun-yong Yoon, Yang-Ick Joo, "A Personal Prescription Management System Employing Optical Character Recognition Technique," Journal of the Korea Institute of Information and Communication Engineering, The Korea Institute of Information and Communication Engineering, Vol. 19, No. 10, pp. 2423-2428, Oct 2015. DOI: https://doi.org/10.6109/jkiice.2015.19.10.2423.
  6. Su-Jin Jeong, In-Seok Kim, "A Study on Analysis of Personal Information Risk Using Importance-Performance Analysis," The Journal of Institute of Internet, Broadcasting and Communication, Vol. 15, No. 6, pp. 267-273, Dec 2015. DOI: https://doi.org/10.7236/JIIBC.2015.15.6.267.
  7. Sang-Gi Lee, Cheol-Joo Chae, Eui-Kyeong Hong, "Quality Management Model of Atypical Science and Technology Big Data Based on Data Profiling and Regular Expression," Journal of The Korea Contents Association, The Korea Contents Society, Vol. 14, No. 12, pp. 486-493, Dec 2015. DOI: https://doi.org/10.5392/JKCA.2014.14.12.486.
  8. Nam-Woo Kim, Chang-Wu Hur, "Study on Performance Evaluation of Automatic license plate recognition program using Emgu CV," Journal of the Korea Institute of Information and Communication Engineering, The Korea Institute of Information and Communication Engineering, Vol. 20, No. 6, pp. 1209-1214, Jun 2016. DOI: https://doi.org/10.6109/jkiice.2016.20.6.1209.
  9. Nam-Gyu Kim, Dong-Eon Kim, Seong-Woo Kim, Soon-Kak Kwon, "Vocabulary Generation Method by Optical Character Recognition," Journal of Korea Multimedia Society, Korea Multimedia Society, Vol. 18, No. 8, pp. 943-949, Aug 2015. DOI: https://doi.org/10.9717/kmms.2015.18.8.943.
  10. Young-Jin Kim, Eun-Gyung Kim, "Image based Fire Detection using Convolutional Neural Network," Journal of the Korea Institute of Information and Communication Engineering, The Korea Institute of Information and Communication Engineering, Vol. 20, No. 19, pp. 1649-1656, Sep 2016. DOI: https://doi.org/10.6109/jkiice.2016.20.9.1649.
  11. Hyun-Woong Jang, Soo-Sun Cho, "Automatic Tagging for Social Images using Convolution Neural Networks," Journal of KIISE, Korea Information Science Society, Vol. 43, No. 1, pp. 47-53, Jan 2016. DOI: https://doi.org/10.5392/JKCA.2014.14.12.486.
  12. Gi-Jin Hwang, Jae-Pyo Park, Seung-Min Yang, "RealTime Personal Video Image Protection on CCTV System using Intelligent IP Camera," Journal of the Korea Academia-Industrial cooperation Society, Korea Academy Industrial Cooperation Society, Vol. 17, No. 9, pp. 120-125, Sep 2016. DOI: https://doi.org/10.5762/KAIS.2016.17.9.120.