Detecting Transitions in Manual Tasks from Wearables: An Unsupervised Labeling Approach†
Journal Title: Informatics - Year 2018, Vol 5, Issue 2
Abstract
Authoring protocols for manual tasks such as following recipes, manufacturing processes or laboratory experiments requires significant effort. This paper presents a system that estimates individual procedure transitions from the user’s physical movement and gestures recorded with inertial motion sensors. Combined with egocentric or external video recordings, this facilitates efficient review and annotation of video databases. We investigate different clustering algorithms on wearable inertial sensor data recorded on par with video data, to automatically create transition marks between task steps. The goal is to match these marks to the transitions given in a description of the workflow, thus creating navigation cues to browse video repositories of manual work. To evaluate the performance of unsupervised algorithms, the automatically-generated marks are compared to human expert-created labels on two publicly-available datasets. Additionally, we tested the approach on a novel dataset in a manufacturing lab environment, describing an existing sequential manufacturing process. The results from selected clustering methods are also compared to some supervised methods.
Authors and Affiliations
Sebastian Böttcher, Philipp M. Scholl and Kristof Van Laerhoven
Keywords
Related Articles
- EP ID EP44144
- DOI https://doi.org/10.3390/informatics5020016
- Views 259
- Downloads 0
Molecular Imaging of Bacterial Infections in vivo: The Discrimination between Infection and Inflammation
Molecular imaging by definition is the visualization of molecular and cellular processes within a given system. The modalities and reagents described here represent a diverse array spanning both pre-clinical and clinic...
Real-Time and Embedded Detection of Hand Gestures with an IMU-Based Glove†
This article focuses on the use of data gloves for human-computer interaction concepts, where external sensors cannot always fully observe the user’s hand. A good concept hereby allows to intuitively switch the interac...
Direct Visual Editing of Node Attributes in Graphs
There are many expressive visualization techniques for analyzing graphs. Yet, there is only little research on how existing visual representations can be employed to support data editing. An increasingly relevant task...
A Data Quality Strategy to Enable FAIR, Programmatic Access across Large, Diverse Data Collections for High Performance Data Analysis
To ensure seamless, programmatic access to data for High Performance Computing (HPC) and analysis across multiple research domains, it is vital to have a methodology for standardization of both data and services. At th...
Bus Operations Scheduling Subject to Resource Constraints Using Evolutionary Optimization
In public transport operations, vehicles tend to bunch together due to the instability of passenger demand and traffic conditions. Fluctuation of the expected waiting times of passengers at bus stops due to bus bunchin...