LAPSE:2024.0130
Published Article
LAPSE:2024.0130
Active Steering Controller for Driven Independently Rotating Wheelset Vehicles Based on Deep Reinforcement Learning
Zhenggang Lu, Juyao Wei, Zehan Wang
January 12, 2024
This paper proposes an active steering controller for Driven Independently Rotating Wheelset (DIRW) vehicles based on deep reinforcement learning (DRL). For the two-axle railway vehicles equipped with Independently Rotating Wheelsets (IRWs), each wheel connected to a wheel-side motor, the Ape-X DDPG controller, an enhanced version of the Deep Deterministic Policy Gradient (DDPG) algorithm, is adopted. Incorporating Distributed Prioritized Experience Replay (DPER), Ape-X DDPG trains neural network function approximators to obtain a data-driven DIRW active steering controller. This controller is utilized to control the input torque of each wheel, aiming to improve the steering capability of IRWs. Simulation results indicate that compared to the existing model-based H∞ control algorithm and data-driven DDPG control algorithm, the Ape-X DDPG active steering controller demonstrates better curving steering performance and centering ability in straight tracks across different running conditions and significantly reduces wheel−rail wear. To validate the proposed algorithm’s efficacy in real vehicles, a 1:5 scale model of the DIRW vehicle and its digital twin dynamic model were designed and manufactured. The proposed control algorithm was deployed on the scale vehicle and subjected to active steering control experiments on a scaled track. The experimental results reveal that under the active steering control of the Ape-X DDPG controller, the steering performance of the DIRW scale model on both straight and curved tracks is significantly enhanced.
Keywords
active steering, Ape-X DDPG algorithm, deep reinforcement learning, independently rotating wheelsets
Suggested Citation
Lu Z, Wei J, Wang Z. Active Steering Controller for Driven Independently Rotating Wheelset Vehicles Based on Deep Reinforcement Learning. (2024). LAPSE:2024.0130
Author Affiliations
Lu Z: Institute of Rail Transit, Tongji University, Shanghai 201804, China
Wei J: Institute of Rail Transit, Tongji University, Shanghai 201804, China [ORCID]
Wang Z: Institute of Rail Transit, Tongji University, Shanghai 201804, China
Journal Name
Processes
Volume
11
Issue
9
First Page
2677
Year
2023
Publication Date
2023-09-06
Published Version
ISSN
2227-9717
Version Comments
Original Submission
Other Meta
PII: pr11092677, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2024.0130
This Record
External Link

doi:10.3390/pr11092677
Publisher Version
Download
Files
[Download 1v1.pdf] (9.9 MB)
Jan 12, 2024
Main Article
License
CC BY 4.0
Meta
Record Statistics
Record Views
71
Version History
[v1] (Original Submission)
Jan 12, 2024
 
Verified by curator on
Jan 12, 2024
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2024.0130
 
Original Submitter
Calvin Tsay
Links to Related Works
Directly Related to This Work
Publisher Version