DOI QR코드

DOI QR Code

Emotion Perception and Multisensory Integration in Autism Spectrum Disorder: A Review of Behavioral and Cognitive Neuroscience Studies

자폐 스펙트럼 장애의 다중감각 통합과 정서인식: 행동연구와 인지 신경 과학 연구에 대한 개관

  • Cho, Hee-Joung (Department of Psychology, Duksung Women's University) ;
  • Kim, So-Yeon (Department of Psychology, Duksung Women's University)
  • 조희정 (덕성여자대학교 심리학과) ;
  • 김소연 (덕성여자대학교 심리학과)
  • Received : 2018.11.01
  • Accepted : 2018.12.13
  • Published : 2018.12.31

Abstract

Behavioral studies of emotion recognition in autism spectrum disorders (ASD) have yielded mixed results. Most of the studies focused on emotion recognition abilities with regard to ASD using stimuli with unisensory modality, making it difficult to determine difficulties in real life emotion perception in ASD. Herein, we review the recent behavioral and cognitive neuroscience studies on emotion recognition functions in ASD, including both unisensory and multisensory emotional information, to elucidate the possible difficulties in emotion recognition in ASD. In our study, we discovered that people with ASD have problems in the process of integrating emotional information during emotion recognition tasks. The following four points are discussed: (1) The restrictions of previous studies, (2) deficits in emotion recognition in ASD especially in recognizing multisensory information, (3) possible compensation mechanisms for emotion recognition in ASD, and (4) the possible roles of attention and language functions in emotion recognition in ASD. The compensatory mechanisms proposed herein for ASD with regard to emotion recognition abilities could contribute to a therapeutic approach for improving emotion recognition functions in ASD.

자폐 스펙트럼 장애를 가진 대상(이하 ASD)의 정서 인식 능력에 대한 행동 연구의 결과는 혼재되어 있고, 대부분 단일 감각 양식의 정서 인식 능력에 대한 검증에 치중되어 있다. 따라서 ASD가 실제로 정서 인식 결함을 가지고 있는지에 대한 통합적 이해는 아직 이루어지지 않은 실정이다. 따라서 본 연구는 다중 감각 양식 정서 자극에 대한 따른 ASD 환자의 정서 인식 능력에 초점을 맞추고, ASD의 정서 인식 능력에 대한 혼재된 결과를 설명하기 위하여 최신 행동연구와 인지신경과학 연구들을 개관하였다. 그 결과, 정서 인식 과제에서 행동적 결함을 보이지 않았던 ASD 일지라도, 뇌 영상 결과에서는 정서 정보 통합 기능에서 결함이 발견되었다. 따라서 본 개관 연구에서는, 최근에 제안된 ASD의 다중 감각 양식에 따른 정서 인식 능력의 결함, ASD의 정서 정보 통합 기능 결함, 그리고 실생활에서 정서 인식의 어려움에 대한 가능성과 선행 연구들의 제한점에 대해 논의하였다. 또한, ASD가 정서 정보를 통합하는 과정에서 활용하는 보상 기제를 살펴보고, ASD의 정서 기능 결함과 관련된 치료적 접근 방향과 후속 연구에 대해 제언하였다.

Keywords

References

  1. Kwon, J. S., Kim, J. J., Namkoong, K., Bahk, W. M., Shin, M. S., Yu, B. H., Yoon, J. S., Lee, S. I., Lee, W. H., Lee, Y. W., Lee, H. J., Rim, H. D., Kang, D. H., Choi, S. H. (2015). Diagnostic and Statistical Manual of Mental Disorders (DSM-5) (fifth ed.). Seoul: Hakjisa.
  2. Kim, S. Y. (2014). Attentional Functions and Dysfunctions in ADHD. Korean Journal of Cognitive & Biological Psychology, 26(2), 67-94. https://doi.org/10.22172/cogbio.2014.26.2.002
  3. Kim, S. Y. (2014). Attentional impairment in patients with schizophrenia. Korean Journal of Cognitive & Biological Psychology, 28(1), 99-122.
  4. Yeon, B. R., Kim, S. Y. (2018). Effects of attentional bias for positive emotion on associative memory in old adults. Korean Journal of Developmental Psychology, 31(1), 50-70.
  5. Lee, J. S., Cho, H. J. (2009). Validation of Autism Spectrum Screening Questionnaire(ASSQ) and the relationship among ASSQ, Theory of Mind, Executive Function, and Social Skills. Korean Journal of Developmental Psychology, 22(1), 93-115.
  6. Cho, H. J., Kim, S. Y. (2017). Effects of reputation on cooperative behaviors in school-age children in social dilemma situations. Journal of Developmental Psychology, 30(4), 161-177.
  7. American Psychiatric Association(2013). Diagnostic and Statistical Manual of Mental Disorders, 5th ed., Washington DC; American Psychiatric Association.
  8. Bal, E., Harden, E., Lamb, D., Van Hecke, A. V., Denver, J. W., & Porges, S. W. (2010). Emotion recognition in children with autism spectrum disorders: relations to eye gaze and autonomic state. Journal of Autism and Developmental Disorders, 40(3), 358-370. DOI: 10.1007/s10803-009-0884-3
  9. Berggren, S., Fletcher-Watson, S., Milenkovic, N. Marschik, P. B., Bolte, S., Jonsson, U.(2017). Emotion recognition training in autism spectrum disorder: A systeatic review of challenges related to generalizability. Developmental Neurorehabilitation, 21(3), 141-151. DOI: 10.1080/17518423.2017.1305004
  10. Charbonneau, G., Bertone, A., Lepore, F., Nassim, M., Lassonde, M., Mottron, L., & Collignon, O. (2013). Multilevel alterations in the processing of audio- visual emotion expressions in autism spectrum disorders. Neuropsychologia, 51(5), 1002-1010. DOI: 10.1016/j.neuropsychologia.2013.02.009
  11. Doi, H., Fujisawa, T. X., Kanai, C., Ohta, H., Yokoi, H., Iwanami, A., Kato, N., & Shinohara, K. (2013). Recognition of Facial Expressions and Prosodic Cues with Graded Emotional Intensities in Adults with Asperger Syndrome. Journal of Autism and Developmental Disorders, 43, 2099-2113. DOI: 10.1007/s10803-013-1760-8.
  12. Doyle-Thomas, K. A., R., Goldberg, J., Szatmari, P., & Hall, G. B. C. (2013). Neurofunctional underpinnings of audiovisual emotion processing in teens with autism spectrum disorders. Frontiers in Psychiatry, 4, DOI: 10.3389/fpsyt.2013.00048
  13. Eigsti, I.-M., Schuh, J., Mencl, E., Schultz, R. T., & Paul, R. (2012). The neural underpinnings of prosody in autism. Child Neuropsychology. A Journal on Normal and Abnormal Development in Childhood and Adolescence, 18(6), 600-617. DOI: 10.1080/09297049.2011.639757.
  14. Fridenson-Hayo, S., Berggren, S., Lassalle, A., Tal, S., Pigat, D., Bolte, S., Baron-Cohen, S., & Golan, O. (2016). Basic and complex emotion recognition in children with autism: cross-cultural findings. Molecular Autism, 7(52), 1-11. DOI: 10.1186/s13229-016-0113-9.
  15. Golan O., Gordon I., Fichman, K., Keinan, G. (2018). Specific Patterns of Emotion Recognition from Faces in Children with ASD: Results of a Cross- Modal Matching Paradigm. Journal of Autism and Developmental Disorders, 48(3), 844-852. DOI: 10.1007/s10803-017-3389-5
  16. Griffiths, S., Jarrold, C., Penton‑Voak, I. S., Woods, A. T., Skinner, A. L., & Munafò, M. R. (2017). Impaired Recognition of Basic Emotions from Facial Expressions in Young People with Autism Spectrum Disorder: Assessing the Importance of Expression Intensity. Journal of Autism and Developmental Disorders, 1-11. DOI: 10.1007/s10803-017-3091-7
  17. Grossman, R. B., & Tager-Flusberg, H. (2012). "who said that?" matching of low- and high-intensity emotional prosody to facial expressions by adolescents with ASD. Journal of Autism and Developmental Disorders, 42(12), 2546-2557. DOI: 10.1007/s10803-012-1511-2.
  18. Hadjikhani, N., Joseph, R. M., Snyder, J., Chabris, C. F., Clark, J., Steele, S., McGrath, L., Vangel, M., Aharon, I., Feczko, E., Harris, G. J., & Tager- Flusberg, H. (2004). Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. Neuroimage, 22(3), 1141-1150. DOI: 10.1016/j.neuroimage.2004.03.025
  19. Harmas, M. B., Martin, A., & Wallace, G. L. (2010). Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies. Neuropsychology Review, 20, 290-322. DOI: 10.1007/s11065-010-9138-6
  20. Jones, C. R. G., Pickles, A., Falcaro, M., Marsden, A. J. S., Happe, F., Scott, S. K., Sauter, D., Tregay, J., Phillips, R. J., Baird, G, Simonoff, E., & Charman, T. (2011). A multi-modal approach to emotion recognition ability in autism spectrum disorders. Journal of Autism Psychology Psychiatry, 52, 275-285. DOI: 10.1111/j.1469-7610.2010.02328.x
  21. Kim, K., Rosenthal, M. Z., Gwaltney, M., Jarrold, W., Hatt, N., Mclntyre, N., Swain, L., Solomon, M., & Mundy, P. (2015). A virtual joy-stick study of emotional responses and social motivation in children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(12), 3891- 3899. DOI: 10.1007/s10803-014-2036-7
  22. Kuusikko, S., Haapsamo, H., Jansson-Verkasalo, E., Hurtig, T., Mattila, M., Ebeling, H., Jussila, K., Bolte, S, & Moilanen, I. (2009). Emotion recognition in children and adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 938-945. DOI: 10.1007/s10803-009-0700-0
  23. Lerner, M. D., McPartlandc, J. C., & Morrisa, J. P. (2013). multi-modal emotion processing in autism spectrum disorders: An event-related potential study. Developmental Cognitive Neuroscience, 3, 11-21. DOI: 10.1016/j.dcn.2012.08.005
  24. Loveland, K. A., Steinberg, J. L., Pearson, D. A., Mansour, R., & Reddoch, S. (2008). Judgments of auditory-visual affective congruence in adolescents with and without autism: a pilot study of a new task using fMRI. Perceptual and Motor Skills, 107, 557-575. DOI: 10.2466/pms.107.2.557-575
  25. Magnee, M. J. C. M., de Gelder, B., van Engeland, H., & Kemner, C. (2007). Facial electromyographic responses to emotional information from faces and voices in individuals with pervasive developmental disorder. Journal of Child Psychology and Psychiatry, 48(11), 1122-1130. DOI: 10.1111/j.1469-7610.2007.01779.x
  26. Magnee, M. J. C. M., de Gelder, B., van Engeland, H., & Kemner, C.(2011). Multisensory integration and attention in autism spectrum disorder: evidence from event-related potentials. PLoS ONE, 6(8): e24196. DOI: 10.1371/journal.pone.0024196
  27. O' Connor, K. (2007). Brief Report: Impaired Identification of Discrepancies Between Expressive Faces and Voices in Adults with Asperger's Syndrome. Journal of Autism and Developmental Disorders, 37(10), 2008-2013. DOI: 10.1007/s10803-006-0345-1
  28. Oerlemans, A. M., van der Meer, J. M. J., van Steijn, D. J., Saskia W. de Ruiter, S. de Bruijn, W., Y. G. E., de Sonneville, L. M. J., Jan K. Buitelaar, J. K., & Rommelse, N. N. J. (2014). Recognition of facial emotion and affective prosody in children with ASD(+ADHD) and their unaffected siblings. European Child & Adolescent Psychiatry, 23, 257-271. DOI: 10.1007/s00787-013-0446-2
  29. Pelphrey, K. A., Morris, J. P., McCarthy, G., & LaBar, K. S. (2007). Perception of dynamic changes in facial affect and identity in autism. Social Cognitive and Affective Neuroscience, 2(2), 140-149. DOI: 10.1093/scan/nsm010
  30. Philip, R. C. M., Whalley, H. C., Stanfield, a C., Sprengelmeyer, R., Santos, I. M., Young, A. W., Atikinson, A. P., Calder, A. J., Johnstone, E. C., Lawrie, S. M., & Hall, J. (2010). Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders. Psychological Medicine, 40(11), 1919-29. DOI: 10.1017/S0033291709992364.
  31. Rozga, A., King, T. Z., Vuduc, R. W., & Robins, D. L. (2013). Undifferentiated facial electromyography responses to dynamic, audio-visual emotion displays in individuals with autism spectrum disorders. Developmental Science, 16(4), 499-514. DOI: 10.1111/desc.12062
  32. Sato, W., Toichi, M., Uono, S., & Kochiyama, T. (2012). Impaired social brain network for processing dynamic facial expressions in autism spectrum disorders. BMC Neuroscience, 13, 99. DOI: 10.1186/1471-2202-13-99
  33. Solomon M, Goodlin-Jones B. L, Anders T. F.(2004). A social adjustment enhancement intervention for high functioning autism, Asperger's syndrome, and pervasive developmental disorder NOS. Journal of Autism and Developmental Disorders, 34, 649-668. DOI: 10.1007/s10803-004-5286-y
  34. Stewart, M. E., McAdam, C., Ota, M., Peppe, S., & Cleland, J. (2011). Emotional recognition in autism spectrum conditions from voices and faces. Autism, 17(1), 6-14. DOI: 10.1177/1362361311424572
  35. Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown C., Stahl., S., Kaiser, M. D., & Schultz, R. T. (2010). Using computerized games to teach face recognition skills to children with autism spectrum disorder: the Let's Face It! Program. Journal of Child Psychology and Psychiatry, 51, 944-952. DOI: 10.1111/j.1469-7610.2010.02258.x
  36. Tardif, C., Laine, F., Rodriguez, M., & Gepner, B. (2007). Slowing Down Presentation of Facial Movements and Vocal Sounds Enhances Facial Expression Recognition and Induces Facial-Vocal Imitation in Children with Autism. Journal of Autism and Developmental Disorders, 37, 1469-1484. DOI: 10.1007/s10803-006-0223-x
  37. Taylor, L. J., Maybery, M, T., Grayndler, L., & Whitehouse, A. J. O. (2015). Evidence for shared deficits in identifying emotions from faces and from voices in autism spectrum disorders and specific language impairment. International Journal of Language and Communication Disorders, 50(4), 452-466. DOI: 10.1111/1460-6984.12146
  38. Taylor, N., Isaac, C., & Milne, E. (2010). A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children. Journal of Autism and Developmental Disorders, 40(11), 1403-1411. DOI: 10.1007/s10803-010-1000-4
  39. Thomas, L. A., De Bellis, M. D., Graham, R., & LaBar, K. S. (2007). Development of emotional facial recognition in late childhood and adolescence. Developmental Science, 10(5), 547-558. DOI: 10.1111/j.1467-7687.2007.00614.x
  40. Vannetzel, L., Chaby, L., Cautru, F., Cohen, D., & Plaza, M. (2010). Neutral versus emotional human stimuli processing in children with pervasive developmental disorders not otherwise specified, Research in Autism, 5(2), 775-783. DOI: 10.1016/j.rasd.2010.09.005
  41. Wang, A. T., Lee, S. S., Sigman, M., & Dapretto, M. (2007). Reading Affect in the Face and Voice: Neural Correlates of Interpreting Communicative Intent in Children and Adolescents With Autism Spectrum Disorders. Arch Gen Psychiatry, 64, 698-708. DOI: 10.1001/archpsyc.64.6.698
  42. Xavier, J., Vignaud, V., Ruggiero, R., Bodeau, N., Cohen, D., & Chaby, L. (2015). A multidimensional approach to the study of emotion recognition in autism spectrum disorders. Frontiers in Psychology, 24(6), DOI: 10.3389/fpsyg.2015.01954.
  43. Young R. L, Posselt, M.(2012). Using the transporters DVD as a learning tool for children with autism spectrum disorders(ASD). Journal of Autism and Developmental Disorders, 42, 984-991. DOI: 10.1007/s10803-011-1328-4