Deep deterministic policy gradient reinforcement learning for collision-free navigation of mobile robots in unknown environments
Journal Title: Firat University Journal of Experimental and Computational Engineering - Year 2023, Vol 2, Issue 2
Abstract
Learning how to navigate in unfamiliar environments is a critical skill for AI-powered mobile robots. Traditional methods for robot navigation typically involve three key steps: positioning, mapping, and route planning. However, in unknown environments, these methods can become outdated because route planning requires an obstacle map. Moreover, classical approaches may become trapped at a local maximum as the environment becomes more complex, which can negatively impact the system's success. Therefore, it is crucial to address collision avoidance in autonomous navigation, both in static and dynamic environments, to ensure that the robot reaches the target safely without any collisions. In recent years, heuristic approaches have gained importance due to their proximity to human behavioral learning. In this paper, we will examine the advantages and disadvantages of using Deep Deterministic Policy Gradient Reinforcement learning methods to guide the robot from the starting position to the target position without colliding with static and dynamic obstacles. By using a reinforcement learning method, the robot can learn from its experiences, make informed decisions, and adapt to changes in the environment. We will explore the efficacy of this method and compare it to traditional approaches to determine its potential for real-world applications. Ultimately, this paper aims to develop a robust and efficient navigation system for mobile robots, which can successfully navigate in unknown and dynamic environments. For this purpose, the system was tested for 100 episodes and the results showed a success rate of over 80%.
Authors and Affiliations
Taner YILMAZ , Omur AYDOGMUS
Keywords
Related Articles
- EP ID EP718144
- DOI 10.5505/fujece.2023.85047
- Views 32
- Downloads 0
Development of an enhanced student identification system
Identification, verification, and student authentication to prevent impersonation during examinations are essential. This is a predominant issue in institutions in developing countries such as Nigeria. This paper designe...
Effect of layer number on bending behavior of 3D spacer composite plates produced with different methods
In this study, the three-point bending behavior of laminated composite plates reinforced with three-dimensional (3D) spacer fabric was experimentally investigated. Composite plate production was carried out using hand l...
Testing The Performance of Random Forest and Support Vector Machine Algorithms for Predicting Cyclist Casualty Severity
Traditional statistical regression models for predicting casualty severity have fundamental limitations. Machine learning algorithms for classifications have started to be applied in severity analysis in order to relax t...
The use of mixed algae species as biocathode in membrane-less microbial fuel cell
Membrane-less microbial fuel cell (MLMFC) is one of the most promising technologies for energy generation from organic wastes. The use of biocathode in the MLMFC system reduces the operation cost and provides many benefi...
Comparison of Photoelectric Conversion Efficiencies of DSSCs Sensitized with Velvet Red Rose and Ivy Rose Dye
In this study, extracts from velvet red rose and ivy rose were used as sensitizers in dye-sensitized solar cells. XRD analyses confirmed the anatase structure of the TiO2 thin film. SEM photographs showed that the nanos...