Outcome-Based Validity and Reliability Assessment of Raters Regarding the Admission Triage Level in the Emergency Department: a Cross-Sectional Study
Journal Title: Advanced Journal of Emergency Medicine - Year 2018, Vol 2, Issue 3
Abstract
Introduction: Emergency department (ED) is usually the first line of healthcare supply to patients in non-urgent to critical situations and, if necessary, provides hospital admission. A dynamic system to evaluate patients and allocate priorities is necessary. Such a structure that facilitates patients’ flow in the ED is termed triage. Objective: This study was conducted to investigate the validity and reliability of implementation of Emergency Severity Index (ESI) system version 4 by triage nurses in an overcrowded referral hospital with more than 80000 patient admissions per year and an average emergency department occupancy rate of more than 80%. Method: This prospective cross-sectional study was conducted in a tertiary care teaching hospital and trauma center with an emergency medicine residency program. Seven participating expert nurses were asked to assess the ESI level of patients in 30 written scenarios twice within a three-week interval to evaluate the inter-rater and intra-rater reliability. Patients were randomly selected to participate in the study, and the triage level assigned by the nurses was compared with that by the emergency physicians. Finally, based on the patients’ charts, an expert panel evaluated the validity of the triage level. Results: During the study period, 527 patients with mean age of 54 ± 7 years, including 253 (48%) women and 274 (52%) men, were assessed by seven trained triage nurses. The degree of retrograde agreement between the collaborated expert panel’s evaluation and the actual triage scales by the nurses and physicians for all 5 levels was excellent, with the Cohen’s weighted kappa being 0.966 (CI 0.985–0.946, p < 0.001) and 0.813 (CI 0.856–0.769, p<0.001), respectively. The intra-rater reliability was 0.94 (p < 0.0001), and the inter-rater reliability for all the nurses was in perfect agreement with the test result (Cohen’s weighted kappa were as follows: 0.919, 0.956, 0.911, 0.955, 0.860, 0.956, and 0.868; p < 0.001). Conclusion: The study findings showed that there was perfect reliability and, overall, almost perfect validity for the triage performed by the studied nurses
Authors and Affiliations
Seyedhossein Seyedhosseini-Davarani, Amir Nejati, Hooman Hossein-Nejad, Seyed-Mohammad Mousavi, Mojtaba Sedaghat, Mona Arbab, Shahram Bagheri-Hariri
Keywords
Related Articles
- EP ID EP378232
- DOI 10.22114/ajem.v0i0.76
- Views 111
- Downloads 0
Sample Size Calculation Guide - Part 2: How to Calculate the Sample Size for an Independent Cohort Study
In the previous article, we explained how to calculate the sample size for a cross-sectional study based on a rate or a single proportion. In this article, we will explain how to calculate the sample size for an independ...
Propofol-Ketamine vs. Propofol-Fentanyl Combinations in Patients Undergoing Closed Reduction: A Randomized, Double-blind, Clinical Trial
Introduction: Painful surgical procedures require adequate sedation and analgesia. A vast array of medications can be used for Procedural Sedation and Analgesia (PSA) in Emergency Departments (EDs). Objective: The prese...
To Head CT Scan or Not: The Clinical Quandary in Suspected Subarachnoid Hemorrhage; a Validation Study on Ottawa Subarachnoid Hemorrhage Rule
Introduction: The Ottawa Subarachnoid Hemorrhage rule (OSR) is a clinical decision tool identified for ruling out subarachnoid hemorrhage (SAH) in those patient above 15 years of age who present to the emergency departme...
Artificial Intelligence-Based Triage for Patients with Acute Abdominal Pain in emergency Department; a Diagnostic Accuracy Study
Introduction: Artificial intelligence (AI) is the development of computer systems which are capable of doing human intelligence tasks such as decision making and problem solving. AI-based tools have been used for predict...
The Effect of Implementation of the Standard Clinical Practice Guideline (CPG) for Management of Multiple Trauma Patients Admitted to an Emergency Department
Introduction: The purpose of triage in the standard Clinical Practice Guide (CPG) for multiple trauma patients is to perform the primary and secondary evaluations in the quickest and shortest possible time with minimal e...