Skip to main navigation menu Skip to main content Skip to site footer

Articles

Vol. 6 No. 3 (2019)

Visual Avoidance of Collision with Randomly Moving Obstacles through Approximate Reinforcement Learning

  • Yunfei ZHANG
  • Yanjun WANG
  • Haoxiang LANG
  • Ying WANG
  • SILVA Clarence W. DE
Submitted
February 5, 2024
Published
2024-02-05

Abstract

In this research work, a hierarchical controller has been designed for an autonomous navigation robot to avoid unexpected moving obstacles where the state and action spaces are continuous. The proposed scheme consists of two parts: 1) a controller with a high-level approximate reinforcement learning (ARL) technique for choosing an optimal trajectory in autonomous navigation; and 2) a low-level, appearance-based visual servoing (ABVS) controller which controls and execute the motion of the robot. A novel approach for path planning and visual servoing has been proposed by the combined system framework. The characteristics of the on-board camera which is equipped on the robot is naturally suitable for conducting the reinforcement learning algorithm. Regarding the ARL controller, the computational overhead is quite low thanks to the fact that a knowledge of obstacle motion is not necessary. The developed scheme has been implemented and validated in a simulation system of obstacle avoidance. It is noted that findings of the proposed method are successfully verified by obtaining an optimal robotic plan motion strategy.

 

Downloads

Download data is not yet available.

Similar Articles

<< < 1 2 3 4 > >> 

You may also start an advanced similarity search for this article.

Most read articles by the same author(s)

1 2 > >>