DOI QR코드

DOI QR Code

Remote Control through Tracking of Pupil on Mobile Device

모바일 기기에서 눈동자 추적을 통한 원격 제어

  • Kim, Su-Sun (Dept. of Computer Information, Hanyang Women's College) ;
  • Kang, Seok-Hoon (Dept. of Embedded System Engineering, University of Incheon) ;
  • Kim, Seon-Woon (Dept. of Embedded System Engineering, University of Incheon)
  • 김수선 (한양여자대학교 컴퓨터정보과) ;
  • 강석훈 (인천대학교 정보기술대학 임베디드시스템공학과) ;
  • 김선운 (인천대학교 정보기술대학 임베디드시스템공학과)
  • Received : 2012.01.05
  • Accepted : 2012.04.12
  • Published : 2012.04.30

Abstract

This paper proposes a method to track the center of pupil and perform the remote control for interface based on the substituted commands according to movements of pupil under smart phone environment. The proposed method, which is a remote control through the movement of eyes, may be helpful for the handicapped people or users who want a more convenient input method. A method based on webcam, which is representative one among the previous methods to track pupil of user, has a few limitations on distance and angle between location of user and webcam. However, this paper uses smart phone that is convenient to carry. The proposed method can perform the remote control through tracking of pupil using wireless network without any restriction on the location of users. Thus, the method is effectively applied for controlling the smart TV that should be controlled on the distance as well as the remote control for PC.

본 논문은 스마트폰을 이용해 눈동자 중심을 추적하여 눈동자의 움직임에 따른 명령으로 치환하고, 이 명령을 통해 인터페이스를 제어하는 방법에 대해 제안한다. 눈을 통해 원격 제어를 하는 이 방법은 신체적 장애가 있는 사람이나 보다 편리한 입력 방법을 원하는 사용자에게 도움을 줄 수 있다. 기존의 방법 중 대표적인 방법으로 웹캠을 이용하여 사용자의 눈동자를 추적하는 방식은 사용자 위치의 거리나 각도에 제약이 존재한다. 하지만, 본 논문에서 제안된 방법은 휴대가 편리한 스마트폰을 이용한다. 제안한 방법은 무선 네트워크를 이용하여 사용자가 위치에 제약받지 않고 눈동자 추적을 통한 원격 제어를 할 수 있다. 이러한 방법은 PC 제어뿐 만 아니라 원격 제어가 반드시 필요한 스마트 TV 제어에 효과적으로 활용될 수 있다.

Keywords

References

  1. Sun-gil Cho, Min Cheol Whang and Munsung Han, "Cursor Movement System by BCI(Brain Computer Interface"in Proc, Ergonomics Society of Korea Conference, pp.49-52, 2002.11
  2. Zhiwei Zhu, Quiang Ji, "Novel Eye Gaze Tracking Techniques Under Natural Head Movement", IEEE Transactions on biomedical engineering, pp.2246-2260, 2007.12
  3. Yoshinobu Ebisawa, "Robust pupil detection by image difference with positional compensation", International Conference, pp.143-148, 2009.5
  4. Dongheng Li, David Winfield, Derric J. Parkhurst, "Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches", IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006.1
  5. M. Betke and N. Makris, "Fast Object Recognition in Noisy Images using Simulated Annealing," in Proc. Fifth Int. Conf. Computer Vision, Boston, MA, USA, pp.523-530, 1995.1.
  6. A. Yuille, P. Hallinan, and D. Cohen, "Feature Extraction from Faces using Deformable Templates," Int. Journal of Computer Vision, Vol.8, No.2, pp.99-111, 1992. 8. https://doi.org/10.1007/BF00127169
  7. P. Viola and M. Jones, "Rapid Object Detection using a Boosted Cascade of Simple Features," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Kauai, HI, USA, pp.511-518, Dec. 2001.
  8. P. Viola and M. Jones, "Robust Real-time Face Detection," Int. Journal of Computer Vision, Vol.57, No.2, pp.137-154, 2004.5. https://doi.org/10.1023/B:VISI.0000013087.49260.fb
  9. T. Ephraim, T. Himmelman, and K. Siddiqi, "Real-Time Viola-Jones Face Detection in a Web Browser," in Proc. Canadian Conf. Computer and Robot Vision, Kelowna, BritishColumbia, Canada, pp.321-328, 2009.5.
  10. J. Ren, N. Kehtarnavaz, and L. Estevez, "Real-Time Optimization of Viola-Jones Face Detection for Mobile Platforms," in Proc. IEEE Dallas Circuits and Systems Workshop SoC: Design, Applications, Integration, and Software, Dallas, TX. USA, pp.1-4, 2008.8.
  11. Kihan Shin, Junchul Chun, "Real Time Eye Tracking based Interface System", Conference of the Korean Society For Internet Information, pp.247-251, 2007.6
  12. Dan Witzner Hansen, Qiang Ji, "In the Eye of the Beholder: A Survey of Models for Eyes and Gaze", IEEE Transactions on pattern analysis and machine intelligence, pp.478-500. 2010.3
  13. Do Hyoung Kim, Jea Hean Kim, Myung Jin Chung, "Human-Computer Interface using the Eye-Gaze Direction", Journal of IEEK Vol.38, No.6, pp.46-56, 2001.11
  14. Kang Ryoung Park, "Gaxe Detection System by Wide and Narrow View Camera", Journal of Korea Information and Communications Society Vol.28, No.12, pp.1239-1249, 2003.12