Agent-Based Convolution and Reinforcement Learning
Journal Title: BEST : International Journal of Management, Information Technology and Engineering ( BEST : IJMITE ) - Year 2017, Vol 5, Issue 12
Abstract
The problem with the current models like Darwin-OP or Boston Dynamic’s ATLAS is their up-time, especially with increased number of joints. These models try mimicking the human motion; they end up using a lot of actuators, which in turn leads to the use of a lot of battery power. This paper discusses the creation of a new model of humanoid robots, that does not try to mimic the bipedal walking gait used by humans, but who instead uses a full model constructed from scratch, that consists of a model free Deep Q-Learning (DQN) algorithm, which doesn’t need any walking sequence or walking models, it just learns from trial and error by applying actions on the robot and observing the reward from that action to make an under-actuated robot able to balance and walk forward, backwards, sideways, and rotate in place using only 4 actuators (two in each leg). The proposed model uses a Regional Convolutional Neural Network (R-CNN) to detect and inform the robot about the place of its goal. A full sensory system of a camera and Inertial Measurement Unit (IMU) is utilized to extract and gather the required inputs for reaching the goal from the robot’ environment. Thus instead of thinking that robot as a pre-programmed entity who performs specific task, we treat this as agent who can learn to take whatever actions towards specific goal controlled by evaluation function to maximize specific reward.
Authors and Affiliations
Samer I. Mohamed, Amr Abdelnabi
Keywords
Related Articles
- EP ID EP264556
- DOI -
- Views 134
- Downloads 0
Criminological Analysis Using Data Mining
Day–by-day the crime rate is increasing considerably and is posing threat to the mankind itself. Criminology is an area that focuses the scientific study of crime and criminal behavior and it’s a process that aims to ide...
A Study on Customers’ Attitude Towards Buying of Organic Vegetables with Special Reference to Chennai City
The study helped to determine organic vegetable consumption in Chennai. It considered and analysed the perception of the consumers, their involvement, and their willingness to buy organic vegetables. Furthermore, it also...
Reciprocal Approach of Mortgage Loans at the Informal Business Sector
This paper seeks to reflect on the informal sector, of housing and financial institutions. The stimulus triggered by OJK (Financial Services Authority) is really a new wind, for the housing finance business, with multi-f...
The Impact of construction Waste to the Environmental on Project Development in Aceh
The development progress in construction industries have the great effects to the environmental especially in environmental change and waste produced. One of the causes of the construction waste is natural resources use...
The Significance of Special Economic Zones in the Economic Development of Zimbabwe: A Case Study of Zim Asset
This study was conducted to establish the significance of special economic zones (SEZs) to the economic development of Zimbabwe. This also included establishing the existence of SEZs in Zimbabwe; evaluating their contrib...