Self-Tuning Parameters of a Maglev Control System Based on Q-Learning
Journal Title: Mechatronics and Intelligent Transportation Systems - Year 2024, Vol 3, Issue 2
Abstract
Maglev transportation, as an innovative mode of rail transit, is regarded as an ideal future transportation system due to its wide speed range, low noise, and strong climbing ability. However, the maglev control system faces challenges such as significant nonlinearity, open-loop instability, and multi-state coupling, leading to issues like insufficient tuning and susceptibility to environmental influences. This paper addresses these problems by investigating the self-tuning parameters of a maglev control system using Q-learning to achieve optimal parameter tuning and enhanced dynamic system performance. The study focuses on a basic levitation unit modeled after the simplified control system of an electromagnetic suspension (EMS) train. A Q-learning reinforcement learning environment and Q-learning agent were established for the levitation system, with a forward "anti-deadlock" reward function and discretization of the action space designed to facilitate reinforcement learning model training. Finally, a Q-learning-based method for self-tuning the parameters of the maglev control system is proposed. Simulation results in the Python environment demonstrate that this method outperforms the Linear Quadratic Regulator (LQR) control method, offering better control effects, improved robustness, and higher tracking accuracy under system parameter perturbations.
Authors and Affiliations
Yang Wang, Yougang Sun, Wen Ji, Junqi Xu
Keywords
Related Articles
- EP ID EP742914
- DOI -
- Views 17
- Downloads 0
A Bibliometric Analysis of Trends and Collaborations in Autonomous Driving Research (2002-2024)
Through the deployment of bibliometric techniques and network visualizations, this analysis synthesizes the evolution and trajectories of autonomous driving research from 2002 to May 2024, as captured in the Scopus datab...
Enhancing Cold Chain Logistics: A Framework for Advanced Temperature Monitoring in Transportation and Storage
In the face of the increasingly demanding of goods transportation and storage, the orchestration of cold chain logistics emerges as a critical and multifaceted endeavor. This study, addressing a notable gap in literature...
Optimizing Vehicle Collision Safety: A Two-Mass Model with Dual Springs and Dampers for Accurate Crash Dynamics Prediction
A comprehensive analysis of vehicle collision dynamics is presented using a two-mass model that simulates the impact of a vehicle against a rigid barrier. The model incorporates dual springs and dampers to examine the in...
Design and Testing of Cooperative Motion Controller for UAV-UGV System
Unmanned ground vehicles (UGVs) and quadrotor unmanned aerial vehicles (UAVs) can work together to solve challenges like intelligent transportation, thanks to their excellent performance complements in perception, loadin...
Incorporating Climate Change Resilience in India’s Railway Infrastructure: Challenges and Potential
This study delves into the crucial task of embedding climate change resilience within the sphere of railway infrastructure planning and design in India. As climate change continues to threaten global transportation syste...