LAPSE:2023.34927
Published Article
LAPSE:2023.34927
A Hybrid Deep Reinforcement Learning and Optimal Control Architecture for Autonomous Highway Driving
April 28, 2023
Autonomous vehicles in highway driving scenarios are expected to become a reality in the next few years. Decision-making and motion planning algorithms, which allow autonomous vehicles to predict and tackle unpredictable road traffic situations, play a crucial role. Indeed, finding the optimal driving decision in all the different driving scenarios is a challenging task due to the large and complex variability of highway traffic scenarios. In this context, the aim of this work is to design an effective hybrid two-layer path planning architecture that, by exploiting the powerful tools offered by the emerging Deep Reinforcement Learning (DRL) in combination with model-based approaches, lets the autonomous vehicles properly behave in different highway traffic conditions and, accordingly, to determine the lateral and longitudinal control commands. Specifically, the DRL-based high-level planner is responsible for training the vehicle to choose tactical behaviors according to the surrounding environment, while the low-level control converts these choices into the lateral and longitudinal vehicle control actions to be imposed through an optimization problem based on Nonlinear Model Predictive Control (NMPC) approach, thus enforcing continuous constraints. The effectiveness of the proposed hierarchical architecture is hence evaluated via an integrated vehicular platform that combines the MATLAB environment with the SUMO (Simulation of Urban MObility) traffic simulator. The exhaustive simulation analysis, carried out on different non-trivial highway traffic scenarios, confirms the capability of the proposed strategy in driving the autonomous vehicles in different traffic scenarios.
Keywords
autonomous highway driving, autonomous vehicles, hierarchical control architecture
Subject
Suggested Citation
Albarella N, Lui DG, Petrillo A, Santini S. A Hybrid Deep Reinforcement Learning and Optimal Control Architecture for Autonomous Highway Driving. (2023). LAPSE:2023.34927
Author Affiliations
Albarella N: Department of Information Technology and Electrical Engineering (DIETI), University of Naples Federico II, 80125 Naples, Italy [ORCID]
Lui DG: Department of Information Technology and Electrical Engineering (DIETI), University of Naples Federico II, 80125 Naples, Italy
Petrillo A: Department of Information Technology and Electrical Engineering (DIETI), University of Naples Federico II, 80125 Naples, Italy [ORCID]
Santini S: Department of Information Technology and Electrical Engineering (DIETI), University of Naples Federico II, 80125 Naples, Italy [ORCID]
Journal Name
Energies
Volume
16
Issue
8
First Page
3490
Year
2023
Publication Date
2023-04-17
Published Version
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en16083490, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.34927
This Record
External Link

doi:10.3390/en16083490
Publisher Version
Download
Files
[Download 1v1.pdf] (875 kB)
Apr 28, 2023
Main Article
License
CC BY 4.0
Meta
Record Statistics
Record Views
81
Version History
[v1] (Original Submission)
Apr 28, 2023
 
Verified by curator on
Apr 28, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.34927
 
Original Submitter
Auto Uploader for LAPSE
Links to Related Works
Directly Related to This Work
Publisher Version