Optimal Strategy for Sit-to-Stand Movement Using Reinforcement Learning
Journal Title: Journal of Rehabilitation Sciences and Research - Year 2017, Vol 4, Issue 3
Abstract
Background: Sit-to-stand motion is a frequent and challenging task in daily life activities especially for elderly and disabled people. Central nervous system uses several strategies for sit-to-stand movement. Many studies have been conducted to understand the underlying basis of the optimal approach. Reinforcement learning (RL) is a suitable method for modeling the control strategies that occur in neuro-musculoskeletal system. Methods: In this paper a dynamic model of human sit-to-stand was derived, and kinematic data of a healthy subject has been extracted in this task. An optimal control problem was formulated considering minimum energy and Q-Learning method has been utilized to find the optimal joint moments during sit to stand movement. Results: The simulation results have been compared to the experimental data. The lower extremity joint angles have been simulated and tracked the actual human angles extracted from the experiments. Also the joints moments showed a satisfactory precision by the proposed approach. Conclusion: An RL-based algorithm was used to model the human sit-to-stand, in which the model explores the state space with a Markov based approach and finds the best actions (joint moments) at each state (posture). In this approach the model successfully performs the task while consuming minimum energy. This was achieved by updating the algorithm in every trial using a Q-learning method.
Authors and Affiliations
Saeed Jamali, Sajjad Taghvaei, Seyyed Arash Haghpanah
Keywords
Related Articles
- EP ID EP374438
- DOI -
- Views 59
- Downloads 0
Can Impairment Interfere with Performance by Women with Carpal Tunnel Syndrome According to International Classification of Function?
Background: Carpal tunnel syndrome is the most prevalent compression neuropathy of upper extremity which, two of the most important risk factors of that are the female sex and manual works. In the model of international...
Cone Beam CT Study of Temporal Crest Canal
Statement of the Problem: It is crucial for clinicians to be certain about the location of mandibular canal and determine any anatomical variants relevant to it. The temporal crest canal (TCC) is a rare anatomical varian...
Comparing Shoulder Joint Functional Range of Motion in Overhead Athletes with and without Shoulder Impingement Syndrome: A Cross-Sectional Study
Background: The shoulder complex is known as one of the most mobile joints of body whose frequently use for overhead movements causes changes in the shoulder joint range of motion. Sub-acromial impingement syndrome (SIS)...
Is Cupping Therapy in Combination with Routine Physical Therapy Effective in the Management of Knee Osteoarthritis? A Randomized Controlled Trial
Background: Osteoarthritis is a common form of arthritis accompanied by varying degrees of disability and reduced quality of life. Several management regimens are available to treat knee osteoarthritis. Cupping therapy i...
Fear of Falling in Patients with Chronic Stroke: Differences of Functional Gait and Balance Measures According to the Level of Concern about Falling
Background: In this study we investigated the differences of functional gait and balance measures between patients with chronic stroke with different level of concern about falling. Methods: Fifty-four patients with chro...