LAPSE:2023.1453
Published Article
LAPSE:2023.1453
Mobile Robot Navigation Using Deep Reinforcement Learning
February 21, 2023
Learning how to navigate autonomously in an unknown indoor environment without colliding with static and dynamic obstacles is important for mobile robots. The conventional mobile robot navigation system does not have the ability to learn autonomously. Unlike conventional approaches, this paper proposes an end-to-end approach that uses deep reinforcement learning for autonomous mobile robot navigation in an unknown environment. Two types of deep Q-learning agents, such as deep Q-network and double deep Q-network agents are proposed to enable the mobile robot to autonomously learn about collision avoidance and navigation capabilities in an unknown environment. For autonomous mobile robot navigation in an unknown environment, the process of detecting the target object is first carried out using a deep neural network model, and then the process of navigation to the target object is followed using the deep Q-network or double deep Q-network algorithm. The simulation results show that the mobile robot can autonomously navigate, recognize, and reach the target object location in an unknown environment without colliding with static and dynamic obstacles. Similar results are obtained in real-world experiments, but only with static obstacles. The DDQN agent outperforms the DQN agent in reaching the target object location in the test simulation by 5.06%.
Keywords
autonomous navigation, collision avoidance, mobile robots, reinforcement learning
Suggested Citation
Lee MFR, Yusuf SH. Mobile Robot Navigation Using Deep Reinforcement Learning. (2023). LAPSE:2023.1453
Author Affiliations
Lee MFR: Graduate Institute of Automation and Control, National Taiwan University of Science and Technology, Taipei 106335, Taiwan; Center for Cyber-Physical System Innovation, National Taiwan University of Science and Technology, Taipei 106335, Taiwan [ORCID]
Yusuf SH: Graduate Institute of Automation and Control, National Taiwan University of Science and Technology, Taipei 106335, Taiwan [ORCID]
Journal Name
Processes
Volume
10
Issue
12
First Page
2748
Year
2022
Publication Date
2022-12-19
Published Version
ISSN
2227-9717
Version Comments
Original Submission
Other Meta
PII: pr10122748, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.1453
This Record
External Link

doi:10.3390/pr10122748
Publisher Version
Download
Files
[Download 1v1.pdf] (7.6 MB)
Feb 21, 2023
Main Article
License
CC BY 4.0
Meta
Record Statistics
Record Views
60
Version History
[v1] (Original Submission)
Feb 21, 2023
 
Verified by curator on
Feb 21, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.1453
 
Original Submitter
Auto Uploader for LAPSE
Links to Related Works
Directly Related to This Work
Publisher Version