Science of Emotion and Sensibility (감성과학)

Korean Society for Emotion and Sensibility (한국감성과학회)
권호 표지
DOI QR코드

DOI QR Code

Design and Evaluation of Multisensory Interactions to Improve Artwork Appreciation Accessibility for the Visually Impaired People

시각장애인의 미술 작품 감상 접근성을 높이는 다중감각 인터랙션의 설계 및 평가

  • Received : 2019.11.18
  • Accepted : 2019.12.02
  • Published : 2020.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study suggests multisensory interaction techniques to help visually impaired people appreciate and understand artworks through non-visual senses such as tactile, auditory, and olfactory senses. A user study was conducted on the basis of a qualitative interview about the experience of appreciating artwork through the multisensory interaction system to visually impaired people so as to verify the development of the interaction techniques. The user test shows that the multisensory interactions in artwork generally not only help them appreciate and understand it but also give them satisfaction through artwork appreciation. However, it also indicates that some multisensory interactions caused the visually impaired people confusion and could not be perceived during the appreciation. On the basis of these outcomes, implications in this study are as follows. This study has contributed to providing specific development guidelines and indicators of non-visual multisensory interactions as a technical alternative to improve accessibility to cultural and artistic activities for the visually impaired. Furthermore, this study is expected to contribute to building a technical background, which can provide comprehensive sensory experiences with not only blind people but also non-blind people such as children and the elderly through universal interaction techniques beyond existing visual-oriented fragmentary experience.

본 연구에서는 시각장애인이 시각 외의 잔존감각인 촉각, 청각, 후각을 활용하여 미술 작품을 감상하고 이해할 수 있도록 도울 수 있는 다중감각 인터랙션 기술을 제안한다. 나아가, 다중감각 인터랙션의 설계 적합성을 평가하기 위해 실제 시각장애인을 대상으로 다중감각 인터랙션 기술이 적용된 시스템을 통해 미술 작품을 감상한 경험에 대한 질적 인터뷰 기반의 사용자 테스트를 수행하였다. 사용자 테스트 결과, 미술 작품에 적용한 다중감각 인터랙션 요소들은 전반적으로 시각장애인으로 하여금 미술 작품 감상 및 이해를 도왔으며, 나아가 다중감각 인터랙션을 통해 미술 작품을 감상한 경험이 만족스러웠다는 긍정적인 평가 결과가 나타났다. 반면, 일부 다중감각 인터랙션 요소는 미술 작품을 감상하는 동안 전혀 인지하지 못하였거나 오히려 미술 작품 감상에 있어서 혼란을 야기했다는 부정적인 평가 결과도 나타났다. 본 연구는 시각장애인의 문화예술 작품 감상의 접근성을 증진할 수 있는 기술적 대안으로서 비시각 다중감각 인터랙션의 구체적인 개발 방향성 및 가이드라인을 제공하는 데 기여하였다. 나아가, 시각장애인뿐만 아니라 아동이나 노인과 같은 비시각장애인도 유니버설 인터랙션 기술을 통해 기존의 시각 위주의 단편적 경험을 넘어선 종합적인 감각적 경험을 할 수 있는 기술 기반을 구축하는데 기여할 수 있을 것으로 기대된다.

Keywords

References

  1. Ablart, D. (2017). Integration of touch and taste with interactive media. In Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video, 109-112. ACM. DOI: 10.1145/3084289.3084294
  2. Axel, E. S., & Levent, N. S. (2003). Art beyond sight: a resource guide to art, creativity, and visual impairment. American Foundation for the Blind.
  3. Cavazos Quero, L., Iranzo Bartolome, J., Lee, S. G., Han, E., Kim, S. H., & Cho, J. D. (2018). An interactive multimodal guide to improve art accessibility for blind people. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, 346-348. ACM. DOI: 10.1145/3234695.3241033
  4. Dmitrenko, D., Maggioni, E., Vi, C. T., & Obrist, M. (2017). What did i sniff?: Mapping scents onto driving-related messages. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 154-163. ACM. DOI: 10.1145/3122986.3122998
  5. Gil, E, Y. (2018). Narrative exploration of art therapy teachers who experienced art therapy for the blind (시각장애인 미술치료를 경험한 미술치료사의 내러티브 탐구), Journal of Korean Association of Qualitative Inquiry, 4(2), 235-273. DOI: 10.30940/JQI.2018.4.2.235
  6. Holloway, L., Marriott, K., & Butler, M. (2018). Accessible maps for the blind: Comparing 3D printed models with tactile graphics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 198. ACM. DOI: 10.1145/3173574.3173772
  7. Iranzo Bartolome, J., Cavazos Quero, L., Kim, S., Um, M. Y., & Cho, J. (2019). Exploring art with a voice controlled multimodal guide for blind people. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction, 383-390. ACM.
  8. Kim, Y. I. (2019). Methods to improve art museum access for the blind: Focusing on assistive tools and museum education program. Seoul National University, Seoul, South Korea.
  9. Lee, D. J., Kang, M. K., & Yoo, K. Y. (2010). Effects of participation of the handicapped in leisure activities upon their life satisfaction depending on disability type. Korean Journal of Family Welfare, 15(4), 137-155.
  10. Lee, Y. H., Kim, S. W., Eom, M. S., An, S. M., Cho, J. D. (2019). An art exhibition needs assessment survey of persons with visual impairment. Asiapacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, 9(1), 457-466. DOI: 10.21742/AJMAHS.2019.01.46
  11. Maggioni, E., Cobden, R., Dmitrenko, D., & Obrist, M. (2018). Smell-O-Message: Integration of olfactory notifications into a messaging application to improve users' performance. In Proceedings of the 2018 on International Conference on Multimodal Interaction, 45-54. ACM. DOI: 10.1145/3242969.3242975
  12. Metatla, O., Maggioni, E., Cullen, C., & Obrist, M. (2019). "Like Popcorn": Crossmodal correspondences between scents, 3D shapes and emotions in children. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, p. 459, ACM. DOI: 10.1145/3290605.3300689
  13. Ministry of Health & Welfare. (2017). Korea institute for health and social affairs, survey on persons with disabilities (장애인실태조사).
  14. Park, J. H., Ryoo, H. K., Kim, N. R., Choi, M. A., Kim, M. S., Park, B. R., Kang, D. I. (2011). Assessment of tactile acuity by two-point discrimination and grating resolution in blind and deaf humans. Science of Emotion & Sensibility, 14(4), 537-544.
  15. Seo, Y. H., Yoon, J. S. (2017). Tactile Sensibility based communication art - focusing on the Exhibition, so通 for the visual impaired. Journal of Korean Society of Media & Arts, 15(3), 41-57. DOI: 10.14728/KCP.2017.15.03.041
  16. Shin, G. L. (2004). Research methodology on qualitative research (질적 연구 방법론), Ewah Womans University Press.
  17. Stangl, A., Kim, J., & Yeh, T. (2014). 3D printed tactile picture books for children with visual impairments: a design probe. In Proceedings of the 2014 Conference on Interaction Design and Children, 321-324. ACM. DOI: 10.1145/2593968.2610482
  18. Vi, C. T., Ablart, D., Gatti, E., Velasco, C., & Obrist, M. (2017). Not just seeing, but also feeling art: Midair haptic experiences integrated in a multisensory art exhibition. International Journal of Human-Computer Studies, 108, 1-14. DOI: 10.1016/j.ijhcs.2017.06.004