Detecting Transitions in Manual Tasks from Wearables: An Unsupervised Labeling Approach†
Journal Title: Informatics - Year 2018, Vol 5, Issue 2
Abstract
Authoring protocols for manual tasks such as following recipes, manufacturing processes or laboratory experiments requires significant effort. This paper presents a system that estimates individual procedure transitions from the user’s physical movement and gestures recorded with inertial motion sensors. Combined with egocentric or external video recordings, this facilitates efficient review and annotation of video databases. We investigate different clustering algorithms on wearable inertial sensor data recorded on par with video data, to automatically create transition marks between task steps. The goal is to match these marks to the transitions given in a description of the workflow, thus creating navigation cues to browse video repositories of manual work. To evaluate the performance of unsupervised algorithms, the automatically-generated marks are compared to human expert-created labels on two publicly-available datasets. Additionally, we tested the approach on a novel dataset in a manufacturing lab environment, describing an existing sequential manufacturing process. The results from selected clustering methods are also compared to some supervised methods.
Authors and Affiliations
Sebastian Böttcher, Philipp M. Scholl and Kristof Van Laerhoven
Keywords
Related Articles
- EP ID EP44144
- DOI https://doi.org/10.3390/informatics5020016
- Views 263
- Downloads 0
A Data Quality Strategy to Enable FAIR, Programmatic Access across Large, Diverse Data Collections for High Performance Data Analysis
To ensure seamless, programmatic access to data for High Performance Computing (HPC) and analysis across multiple research domains, it is vital to have a methodology for standardization of both data and services. At th...
Social Media Providing an International Virtual Elective Experience for Student Nurses
The advances in social media offer many opportunities for developing understanding of different countries and cultures without any implications of travel. Nursing has a global presence and yet it appears as though stud...
Modelling Digital Knowledge Transfer: Nurse Supervisors Transforming Learning at Point of Care to Advance Nursing Practice
Limited adoption of mobile technology for informal learning and continuing professional development within Australian healthcare environments has been explained primarily as an issue of insufficient digital and ehealth...
Big Data in the Era of Health Information Exchanges: Challenges and Opportunities for Public Health
Public health surveillance of communicable diseases depends on timely, complete, accurate, and useful data that are collected across a number of healthcare and public health systems. Health Information Exchanges (HIEs)...
Health Literacy for the General Public: Making a Case for Non-Trivial Visualizations
Health literacy is concerned with the degree to which individuals can access and understand information to make health decisions. The multifaceted nature of health data presents challenges for individuals seeking to im...