Optimal Strategy for Sit-to-Stand Movement Using Reinforcement Learning
Journal Title: Journal of Rehabilitation Sciences and Research - Year 2017, Vol 4, Issue 3
Abstract
Background: Sit-to-stand motion is a frequent and challenging task in daily life activities especially for elderly and disabled people. Central nervous system uses several strategies for sit-to-stand movement. Many studies have been conducted to understand the underlying basis of the optimal approach. Reinforcement learning (RL) is a suitable method for modeling the control strategies that occur in neuro-musculoskeletal system. Methods: In this paper a dynamic model of human sit-to-stand was derived, and kinematic data of a healthy subject has been extracted in this task. An optimal control problem was formulated considering minimum energy and Q-Learning method has been utilized to find the optimal joint moments during sit to stand movement. Results: The simulation results have been compared to the experimental data. The lower extremity joint angles have been simulated and tracked the actual human angles extracted from the experiments. Also the joints moments showed a satisfactory precision by the proposed approach. Conclusion: An RL-based algorithm was used to model the human sit-to-stand, in which the model explores the state space with a Markov based approach and finds the best actions (joint moments) at each state (posture). In this approach the model successfully performs the task while consuming minimum energy. This was achieved by updating the algorithm in every trial using a Q-learning method.
Authors and Affiliations
Saeed Jamali, Sajjad Taghvaei, Seyyed Arash Haghpanah
Keywords
Related Articles
- EP ID EP374438
- DOI -
- Views 99
- Downloads 0
Effects of Chronic Otitis Media with Effusion on Amblyaudia
Background: Chronic otitis media with effusion (CME) primarily affects children. Temporary auditory deprivation is a serious complication of this disease and can result in auditory processing disorder, as demonstrated in...
Development, Validity and Reliability of the Persian Version of the Consonant-Vowel in White Noise Test
Background: One of the most common complaints expressed by individuals with hearing-impairment is the difficulty in speech perception in background noise. Different tests have been developed for the evaluation of reduced...
Comparison of Participation in Life Habits in 5–11-Year-Old Blind and Typical Children
Background: Participation is defined as involvement in life situations leading to skill development, experimentation, and socialization. Children with visual impairment seem to be at risk because of their limitations whe...
Social Phobia in Persian Adults with Stuttering
Background: Stuttering is a communication disorder. It is expected that stuttering may have negative impact on individuals’ mental and emotional health, which may affect their quality of life. Therefore, this paper aims...
Differences in Cervical Extensor Muscles Thickness on Subjects with Normal Head Posture and Forward Head Posture; an Ultrasonography Study
Background: Forward head posture (FHP) is recognized as a common postural disorder of modern societies. Increase in anterior cervical convexity and anterior displacement of the line of gravity of head in individuals with...