Crowd Sourced Assessment of Technical Skills (CSATS): A Scalable Assessment Tool for the Nursing Workforce
Journal Title: Archives of Nursing Practice and Care - Year 2016, Vol 2, Issue 1
Abstract
Background: In the current healthcare environment, education for technical skills focuses on quality improvement that demands ongoing skill assessment. Objectively assessing competency is a complex task that, when done effectively, improves patient care. Current methods are time-consuming, expensive, and subjective. Crowdsourcing is the practice of obtaining services from a large group of people, typically the general public on an online community. CSATS (Crowd Sourced Assessment of Technical Skills) uses crowdsourcing as an innovative way to rapidly, objectively, and comprehensively assess technical skills. We hypothesized that CSATS could accurately evaluate the technical skill proficiency of nurses. Methods: An interface displaying one of 34 video-recorded nurses performing a glucometer skills test and a corresponding survey listing each required step were uploaded to an Amazon.com hosted crowdsourcing site, Mechanical Turk™. The crowd evaluated completion and sequence of the glucometer steps in each video. Results: In under 4 hours, we obtained 1,300 crowd ratings, approximately 38 per video that evaluated the user’s performance based on completion and correct order of steps. The crowd identified individual performance variance, specific steps frequently missed by users, and provided feedback tailored to each user. CSATS identified 15% of nurses who would benefit from additional training. Conclusion: Our study showed that healthcare-naïve crowd workers can assess technical skill proficiency rapidly and accurately at nominal cost. CSATS may be a valuable tool to assist educators in creating targeted training curricula for nurses in need of follow up while rapidly identifying nurses whose technical skills meet expectations, thus, dramatically reducing the resource burden for training.
Authors and Affiliations
Kirsch Sarah, Comstock Bryan, Harder Leslie, Henriques Amy, Lendvay Thomas S
Keywords
Related Articles
- EP ID EP342309
- DOI 10.17352/anpc.000012
- Views 56
- Downloads 0
Survival Determinants in Endometrial Cancer Patients: 5-Years Experience
Aim: The aim of the study was to explore five years survival in women with endometrial cancer. Material and methods: A retrospective review of 146 patients with endometrial cancer treated at Baskent University Hospital G...
Mary Frances Crowley: Vision, Values and Principles still alive and flourishing?
Summary: Mary Frances Crowley nurse, midwife and nurse and midwifery tutor was founder member and first Dean of the Faculty of Nursing and Midwifery in the Royal College of Surgeons in Ireland. She started the Medical Mi...
Preventing Postoperative Healthcare Associated Infections: The Experience of Two European Cardiac Surgery Intensive Care Units
Aims: to investigate the relationship between nursing workloads (first shift) and Healthcare-associated Infections (HAI) in two European Cardiac Surgery Intensive Care Units (ICUs). Background: Critically ill patients ma...
Affective Bond, Loneliness and Socioeconomic Aspects of an Elderly Population in Midwest, Brazil
Background: loneliness, a common feature among elderly people, can affect health and quality of life. Objective: this article examined affective bond and marital status among elders in “Barra do Garças”, municipality, M...
Effects of “Eight-Point Regulation” and “Chinese Military Bans Luxury Banquets” on Price, Sale, and Consumption of High-End Alcohol Products in China
Background: Alcohol use disorder was linked to corruption, abuse of power, and bureaucratic inefficiency in mainland China. The Communist Party of China issued the “Eight-Point Regulation” and “Luxury Banquets Ban for Ch...