Crowd Sourced Assessment of Technical Skills (CSATS): A Scalable Assessment Tool for the Nursing Workforce
Journal Title: Archives of Nursing Practice and Care - Year 2016, Vol 2, Issue 1
Abstract
Background: In the current healthcare environment, education for technical skills focuses on quality improvement that demands ongoing skill assessment. Objectively assessing competency is a complex task that, when done effectively, improves patient care. Current methods are time-consuming, expensive, and subjective. Crowdsourcing is the practice of obtaining services from a large group of people, typically the general public on an online community. CSATS (Crowd Sourced Assessment of Technical Skills) uses crowdsourcing as an innovative way to rapidly, objectively, and comprehensively assess technical skills. We hypothesized that CSATS could accurately evaluate the technical skill proficiency of nurses. Methods: An interface displaying one of 34 video-recorded nurses performing a glucometer skills test and a corresponding survey listing each required step were uploaded to an Amazon.com hosted crowdsourcing site, Mechanical Turk™. The crowd evaluated completion and sequence of the glucometer steps in each video. Results: In under 4 hours, we obtained 1,300 crowd ratings, approximately 38 per video that evaluated the user’s performance based on completion and correct order of steps. The crowd identified individual performance variance, specific steps frequently missed by users, and provided feedback tailored to each user. CSATS identified 15% of nurses who would benefit from additional training. Conclusion: Our study showed that healthcare-naïve crowd workers can assess technical skill proficiency rapidly and accurately at nominal cost. CSATS may be a valuable tool to assist educators in creating targeted training curricula for nurses in need of follow up while rapidly identifying nurses whose technical skills meet expectations, thus, dramatically reducing the resource burden for training.
Authors and Affiliations
Kirsch Sarah, Comstock Bryan, Harder Leslie, Henriques Amy, Lendvay Thomas S
Keywords
Related Articles
- EP ID EP342309
- DOI 10.17352/anpc.000012
- Views 75
- Downloads 0
Resilience in later life: A critical role for Nursing?
The population is aging. Gratton (2016) writes that we will soon be living to 100. The nursing profession has a major role today in promoting, supporting and maintaining healthy habits and resilience in this aging grou...
The effectiveness of nursing intervention on breastfeeding-related problems among nursing mothers in selected primary health clinics in Lagos, Nigeria
Breastfeeding is a vital component of realizing every child’s right to the highest attainable standard of health, while respecting every mother’s right to make an informed decision about how to feed her baby. Several fac...
Reasons why Hypertensive Patients Admission to Emergency Services and their Chronic Illness Care Management
The study sample was composed of 200 individuals with hypertension who were admitted to the emergency department of a government hospital. Of the participants, 36.5% presented to the emergency department. Of the particip...
Affective Bond, Loneliness and Socioeconomic Aspects of an Elderly Population in Midwest, Brazil
Background: loneliness, a common feature among elderly people, can affect health and quality of life. Objective: this article examined affective bond and marital status among elders in “Barra do Garças”, municipality, M...
Health Behaviors of Centenarians are Worth Attention
In contemporary society, it’s important to prevent and minimize the impact of non-communicable disease [1]. Health behaviors, such as physical inactivity, smoking, obesity, poor diets, and alcohol misuse are among the mo...