Autonomous Robot Navigation in Dynamic Environments: A Temporal-Difference Learning Approach

Subject Areas : International Journal of Decision Intelligence

arsalan montazeri ¹ , sara Shademani Alishah ² , vajiheh Ghasemi ³

1 - Arsalan Montazeri Northeastern University, Department of project management, First Canadian Place, 100 King St W, Toronto, ON M5X 1E2. Email address: [e-mail]
2 - University of Windsor, Department of Industrial Engineering,canada
3 - Applied Mechanics Department, University of Rome Tor Vergata, Italy

Received: 2023-11-13 Accepted : 2024-04-25 Published : 2024-09-22

Keywords: Autonomous Robot Navigation, Temporal-Difference Learning, Dynamic Environments, Reinforcement Learning, ,

Abstract :

In this paper, we address the critical challenges of robotic navigation in dynamic environments, increasingly relevant with rapid advancements in robotics and artificial intelligence. Traditional navigation methods, reliant on predefined paths and detailed mapping, often fail in such unpredictable settings. Our research introduces a novel approach using temporal-difference learning, a form of reinforcement learning, to enhance robot navigation in these scenarios. We explore the difficulties posed by dynamic environments, such as moving obstacles and changing terrains, and demonstrate the adaptability of temporal-difference learning in overcoming these challenges. Our method, tested through rigorous experiments, shows significant improvements in adaptability, reduced collisions, and enhanced pathfinding efficiency in various simulated conditions. These results emphasize the potential of our approach in creating more resilient robotic systems for complex situations, including urban landscapes, disaster areas, or extraterrestrial environments. This paper contributes to the field of robotics by offering a promising solution to navigate dynamic settings, opening new possibilities for robotic deployment in intricate and unpredictable environments.