Optimal Strategy for Sit-to-Stand Movement Using Reinforcement Learning
Journal Title: Journal of Rehabilitation Sciences and Research - Year 2017, Vol 4, Issue 3
Abstract
Background: Sit-to-stand motion is a frequent and challenging task in daily life activities especially for elderly and disabled people. Central nervous system uses several strategies for sit-to-stand movement. Many studies have been conducted to understand the underlying basis of the optimal approach. Reinforcement learning (RL) is a suitable method for modeling the control strategies that occur in neuro-musculoskeletal system. Methods: In this paper a dynamic model of human sit-to-stand was derived, and kinematic data of a healthy subject has been extracted in this task. An optimal control problem was formulated considering minimum energy and Q-Learning method has been utilized to find the optimal joint moments during sit to stand movement. Results: The simulation results have been compared to the experimental data. The lower extremity joint angles have been simulated and tracked the actual human angles extracted from the experiments. Also the joints moments showed a satisfactory precision by the proposed approach. Conclusion: An RL-based algorithm was used to model the human sit-to-stand, in which the model explores the state space with a Markov based approach and finds the best actions (joint moments) at each state (posture). In this approach the model successfully performs the task while consuming minimum energy. This was achieved by updating the algorithm in every trial using a Q-learning method.
Authors and Affiliations
Saeed Jamali, Sajjad Taghvaei, Seyyed Arash Haghpanah
Keywords
Related Articles
- EP ID EP374438
- DOI -
- Views 92
- Downloads 0
Efficiency of Castor Oil as a Storage Medium for Avulsed Teeth in Maintaining the Viability of Periodontal Ligament Cells
Statement of the Problem: Researchers always seek a new storage medium for avulsed teeth. Castor oil is a vegetable oil with several advantages such as antimicrobial and antioxidant properties, low toxicity, and glutathi...
Standardization of Connor-Davidson Resilience Scale in Iranian subjects with Cerebrovascular Accident
Background: Resilience is a personal trait that can influence the stroke subjects’ attitudes toward future opportunities and facilitate the transitional process and adaptation in them. Assessment of this trait in stroke...
Effects of Special Pelvic Floor Muscle Training on the Quality of Life in Women with Urinary Incontinence, A Clinical Trial
Background: Stress urinary incontinence (SUI) is the involuntary loss of urine which occurs with physical exertion and an increase in intra-abdominal pressure. Pelvic floor muscle training (PFMT) is generally recommended...
The Comparison of the Effects of Two Fatigue Protocols on Triceps- Surae Musculotendinous Stiffness in Healthy Female Students
Background: Previous studies have investigated different effects of muscle fatigue on body systems. However, there are no reports on the effect of fatigue protocol and its level on musculotendinous stiffness (MTS) of the...
Optimal Strategy for Sit-to-Stand Movement Using Reinforcement Learning
Background: Sit-to-stand motion is a frequent and challenging task in daily life activities especially for elderly and disabled people. Central nervous system uses several strategies for sit-to-stand movement. Many studi...