The Journal of the Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회논문지)

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Design and Implementation of Mobile Communication System for Hearing- impaired Person

청각 장애인을 위한 모바일 통화 시스템 설계 및 구현

  • 윤동희 (한성대학교 컴퓨터공학과) ;
  • 김영웅 (한성대학교 컴퓨터공학부)
  • Received : 2016.07.26
  • Accepted : 2016.10.07
  • Published : 2016.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

According to the Ministry of Science, ICT and Future Planning's survey of information gap, smartphone retention rate of disabled people stayed in one-third of non-disabled people, the situation is significantly less access to information for people with disabilities than non-disabled people. In this paper, we develop an application, CallHelper, that helps to be more convenient to use mobile voice calls to the auditory disabled people. CallHelper runs automatically when a call comes in, translates caller's voice to text output on the mobile screen, and displays the emotion reasoning from the caller's voice to visualize emoticons. It also saves voice, translated text, and emotion data that can be played back.

미래창조과학부의 정보격차 실태조사에 따르면 장애인의 스마트폰 보유율은 일반인의 1/3 수준에 머물러 있어 장애인의 정보접근성은 비장애인에 비해 현저히 떨어지는 실정이다. 본 논문은 청각장애인의 모바일 음성 통화를 보다 편리하게 사용할 수 있도록 도와주는 어플리케이션인 CallHelper를 개발하였다. CallHelper는 전화가 오면 자동으로 구동되어 상대방의 전화음성을 텍스트로 실시간 번역하여 모바일 화면에 출력하고, 상대방의 음성에서 감정을 추론하여 이모티콘으로 시각화해서 표시하며, 음성과 번역된 텍스트, 감정을 동시에 저장하여 추후 번역결과를 확인해 볼 수 있도록 하는 어플리케이션이다.

Keywords

References

  1. S. S. Yang, S. C. Park, "Design and Implementation of CTI System for Hearing Impaired People in Mobile Environment", The Journal of The Institute of Internet, Broadcasting and Communication, Vol. 13, No. 6, pp.47-54, 2013. https://doi.org/10.7236/JIIBC.2013.13.6.47
  2. https://cloud.google.com/speech/
  3. http://www.json.org/json-ko.html
  4. A. Ossama, A. Mohamed, H. Jiang, L. Deng, G. Penn, D. Yu,"Convolutional neural networks for speech recognition", IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP), Vol. 22 No. 10, pp.1533-1545, 2014. https://doi.org/10.1109/TASLP.2014.2339736
  5. A. Graves, N. Jaitly, "Towards End-to-End Speech Recognition with Recurrent Neural Networks", Proceedings of the 31st International Conference on Machine Learning, 2014.
  6. http://practicalcryptography.com/miscellaneous/machine-learning/guide-mel-frequency-cepstralcoefficients-mfccs/
  7. https://developer.android.com/studio/index.html
  8. Z. Chen, T. Ellis, "A self-adaptive Gaussian mixture model", Computer Vision and Image Understanding 122, pp.35-46, Elsevier, 2014. https://doi.org/10.1016/j.cviu.2014.01.004