Optimal Strategy for Sit-to-Stand Movement Using Reinforcement Learning
Journal Title: Journal of Rehabilitation Sciences and Research - Year 2017, Vol 4, Issue 3
Abstract
Background: Sit-to-stand motion is a frequent and challenging task in daily life activities especially for elderly and disabled people. Central nervous system uses several strategies for sit-to-stand movement. Many studies have been conducted to understand the underlying basis of the optimal approach. Reinforcement learning (RL) is a suitable method for modeling the control strategies that occur in neuro-musculoskeletal system. Methods: In this paper a dynamic model of human sit-to-stand was derived, and kinematic data of a healthy subject has been extracted in this task. An optimal control problem was formulated considering minimum energy and Q-Learning method has been utilized to find the optimal joint moments during sit to stand movement. Results: The simulation results have been compared to the experimental data. The lower extremity joint angles have been simulated and tracked the actual human angles extracted from the experiments. Also the joints moments showed a satisfactory precision by the proposed approach. Conclusion: An RL-based algorithm was used to model the human sit-to-stand, in which the model explores the state space with a Markov based approach and finds the best actions (joint moments) at each state (posture). In this approach the model successfully performs the task while consuming minimum energy. This was achieved by updating the algorithm in every trial using a Q-learning method.
Authors and Affiliations
Saeed Jamali, Sajjad Taghvaei, Seyyed Arash Haghpanah
Keywords
Related Articles
- EP ID EP374438
- DOI -
- Views 104
- Downloads 0
Assessment and Comparison of Rapid Weight Loss Methods and its Complications in Various Weight Groups of Adult Elite Wrestlers
Background: The prevalence of rapid weight loss methods among wrestlers has raised concerns about their health and performance. This study aimed to assess and compare rapid weight loss methods and its general effects on...
The Grammatical Deficits of Persian-Speaking Children with Specific Language Impairment
Background: Specific language impairment (SLI) is one of the most common disorders of language development in children, which has been less addressed in Persian studies. The aim of this study was to evaluate the grammati...
Prediction of Scapular Dyskinesis Through Electromyographic Indices of Scapulothoracic Muscles in Female Overhead Athletes
Background: Shoulder joint function and the athletic performance of overhead athletes are influenced by scapular dyskinesis (SD) due to its high prevalence among these athletes and the motor interaction between the scapu...
The Effects of Listening to Persian Music on the Hand Dexterity and Depression in a Patient with Stroke: A Case Report
Introduction: Nowadays the use of music therapy for neurological disorders in developed countries is widely emphasized. Despite this, there is little scientific evidence regarding the use of this method for the treatment...
Biomechanical Evaluation of Spontaneous Repair of Osteochondral Defects in the Rabbit Knee
Background: Examination of cartilage repair in animal work is dependent upon the thickness and radius of the induced impalement. Full-thickness defects with a radius of 3 mm have been commonly used in animal studies to e...