Journal of East-West Nursing Research (동서간호학연구지)

East-west Nursing Research Institute, Kyung Hee University (경희대학교 동서간호학연구소)
권호 표지
DOI QR코드

DOI QR Code

Inter-rater Reliability of Korean Triage and Acuity Scale (KTAS) among the Research Nurses and the Triage Nurses

한국형 응급환자 분류도구의 간호사 간 신뢰도 평가

  • Yang, Jungeun (Department of Emergency Department, Konkuk University Medical Center) ;
  • Lee, Eunja (College of Nursing, Gachon University)
  • 양정은 (건국대학교병원 응급의료센터) ;
  • 이은자 (가천대학교 간호대학원)
  • Received : 2020.03.26
  • Accepted : 2020.05.14
  • Published : 2020.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose: The study aims to assess the inter-rater reliability of the Korean Triage and Acuity Scale between the research nurses and the triage nurses. Methods: Interrater reliability was measured on 400 adult (≧15) and 400 pediatric (<15) patients who visited the emergency medical center from January 4 to June 30, 2018. Results: The study result showed that the inter-rater reliability of the Korean Triage and Acuity Scale was substantial, with κ=.73 (95% Confidence interval= .68-.78) and 77.0 percent agreement. The inter-rater of Pediatric Korean Triage and Acuity Scale was also substantial, with κ=.76 (95% Confidence interval= .71-.82) and 83.8 percent agreement. Conclusion: Although the inter-rater reliability of the Korean Triage and Acuity Scale was acceptable, the percent agreement was lower than the desirable level (<80.0%). It was confirmed that Pediatric Korean Triage and Acuity Scale had an acceptable level of inter-rater reliability and percent agreement for clinical use. Efforts should be made to improve the reliability in the future.

Keywords

References

  1. Fernandes CM, Tanabe P, Gilboy N, Johnson LA, McNair RS, Rosenau AM, et al. Five-level triage: a report from the ACEP/ENA five-level triage task force. J Emerg Nurs. 2005;31(1):39-50. https://doi.org/10.1016/j.jen.2004.11.002
  2. Park J, Lim T. Korean Triage and Acuity Scale (KTAS). J Korean Soc Emerg Med. 2017;28(6):547-51. https://doi.org/10.22470/pemj.2015.2.2.53
  3. Mirhaghi A, Heydari A, Mazlom R, Ebrahimi M. The reliability of the Canadian triage and acuity scale: meta-analysis. N Am J Med Sci. 2015;7(7):299-305. http://doi.org/10.4103/1947-2714.161243
  4. Zachariasse JM, van der Hagen V, Seiger N, Mackway-Jones K, van Veen M, Moll HA. Performance of triage systems in emergency care: a systematic review and meta-analysis. BMJ Open. 2019;9(5):e026471. http://doi.org/10.1136/bmjopen-2018-026471
  5. Magalhães-Barbosa MC, Robaina JR, Prata-Barbosa A, Lopes CDS. Reliability of triage systems for paediatric emergency care: a systematic review. Emerg Med J. 2019;36(4):231-8. http://doi.org/10.1136/emermed-2018-207781
  6. Magalhaes-Barbosa MC, Robaina JR, Prata-Barbosa A, Lopes CDS. Validity of triage systems for paediatric emergency care: a systematic review. Emerg Med J. 2017;34(11):711-9. http://doi.org/10.1136/emermed-2016-206058
  7. The Korean Society of Emergency Medicine. Reliability and validity verification study of the Korean Triage and Acuity Scale[Internet]. Sejong: Ministry of Health and Welfare; 2014 [cited 2020 March 4]. Available from: http://www.prism.go.kr/homepage/entire/retrieveEntireDetail.do?pageIndex=1&research_id=1351000-201400241&left-MenuLevel=160&cond_research_name=한국형+중증%.
  8. Chang YC, Ng CJ, Wu CT, Chen LC, Chen JC, Hsu KH. Effectiveness of a five-level Paediatric Triage System: an analysis of resource utilisation in the emergency department in Taiwan. Emerg Med J. 2013;30(9):735-9. https://doi.org/10.1136/emermed-2012-201362
  9. Bullard MJ, Chan T, Brayman C, Warren D. Revisions to the Canadian emergency department Triage and Acuity Scale (CTAS) Guidelines. CJEM. 2014;16(6):485-9. https://doi.org/10.1017/S148180350000350X
  10. Takahashi T, Inoue N, Shimizu N, Terakawa T, Goldman RD. "Downtriage" for children with abnormal vital signs: evaluation of a new triage practice at a paediatric emergency department in Japan. Emerg Med J. 2016;33(8):533-7. http://doi.org/10.1136/emermed-2015-204968
  11. Haas B, Gomez D, Zagorski B, Stukel TA, Rubenfeld GD, Nathens AB. Survival of the fittest: the hidden cost of undertriage of major trauma. J Am Coll Surg. 2010;211(6):804-11. http://doi.org/10.1016/j.jamcollsurg.2010.08.014
  12. Armstrong JH, Hammond J, Hirshberg A, Frykberg ER. Is overtriage associated with increased mortality? The evidence says "yes." Disaster Med Public Health Pre. 2008;2(1):4-5. http://doi.org/10.1097/DMP.0b013e31816476c0
  13. Choi HJ, Ok JS, An SY. Evaluation of Validity of the Korean Triage and Acuity Scale. J Korean Acad Nurs. 2019;49(1):26-35. https://doi.org/10.4040/jkan.2019.49.1.26
  14. Iserson KV, Moskop JC. Triage in medicine, part I: concept, history, and types. Ann Emerg Med. 2007;49(3):275-81. https://doi.org/10.1016/j.annemergmed.2006.05.019
  15. Park CU, Kim HJ. Measurement of inter-rater reliability in systematic review. Hanyang Med Rev. 2015;35(1):44-9. https://doi.org/10.7599/hmr.2015.35.1.44
  16. Worster A, Sardo A, Eva K, Fernandes CMB, Upadhye S. Triage Tool inter-rater reliability: a comparison of live versus paper case scenarios. J Emerg Nurs. 2007;33(4):319-23. https://doi.org/10.1016/j.jen.2006.12.016
  17. Ying R, Sern W, Glen S, Khairil A, Jamil M, Wai W, et al. Comparison of the Emergency Severity Index versus the Patient Acuity Category Scale in an emergency setting. Int Emerg Nurs. 2018;41:13-8. https://doi.org/10.1016/j.ienj.2018.05.001
  18. Bujang MA, Baharum N. Guidelines of the minimum sample size requirements for Cohen's Kappa. Epidemiol Biostat Public Health. 2017; 14(2):e122671-1-10. https://doi.org/10.2427/12267
  19. The Korean Society of Emergency Medicine KTAS Committee. Korean Triage and Acuity Scale manual version 3. Paju: Koonja; 2019. pp.11-30.
  20. Park JB, Lee J, Kim YJ, Lee JH. Reliability of Korean Triage and Acuity Scale : interrater agreement between two experienced nurses by real-time triage and analysis of influencing factors to disagreement of triage levels. J Korean Med Sci. 2019;34(28):1-7. https://doi.org/10.3346/jkms.2019.34.e189
  21. Moon S, Lan J, Id S, Park K, Park C. Triage accuracy and causes of mistriage using the Korean Triage and Acuity Scale. PLoS One. 2019; 14(9):e0216972. https://doi.org/10.1371/journal.pone.0216972
  22. Moon S, Shim JL. Triage Accuracy of pediatric patients using the Korean Triage and Acuity Scale in emergency departments. J Korea Acad Industr Coop Soc. 2018;19(11):626-34. https://doi.org/10.5762/KAIS.2018.19.11.626
  23. Lee JH, Park YS, Park IC, Lee HS, Kim JH, Park JM, et al. Over-triage occurs when considering the patient's pain in Korean Triage and Acuity Scale (KTAS). PLoS One. 2019;14(5):e0216519. http://dx.plos.org/10.1371/journal.pone.0216519
  24. Peacock S, Patel S. Cultural influences on pain. Rev Pain. 2008;1(2):6-9. https://doi.org/10.1177/204946370800100203
  25. Ministry of Health and Welfare. Enactment of the Korean emergency patients severity classification standard: article 2015-243 [Internet]. Sejong: Ministry of Health and Welfare; 2015 [cited 2020 March 04]. Available from: http://www.mohw.go.kr/react/jb/sjb0406vw.jsp?PAR_MENU_ID=03&MENU_ID=030406&CONT_SEQ=329273