Training an Agent for FPS Doom Game using Visual Reinforcement Learning and VizDoom

Abstract

Because of the recent success and advancements in deep mind technologies, it is now used to train agents using deep learning for first-person shooter games that are often outperforming human players by means of only screen raw pixels to create their decisions. A visual Doom AI Competition is organized each year on two different tracks: limited death-match on a known map and a full death-match on an unknown map for evaluating AI agents, because computer games are the best test-beds for testing and evaluating different AI techniques and approaches. The competition is ranked based on the number of frags each agent achieves. In this paper, training a competitive agent for playing Doom’s (FPS Game) basic scenario(s) in a semi-realistic 3D world ‘VizDoom’ using the combination of convolutional Deep learning and Q-learning by considering only the screen raw pixels in order to exhibit agent’s usefulness in Doom is proposed. Experimental results show that the trained agent outperforms average human player and inbuilt game agents in basic scenario(s) where only move left, right and shoot actions are allowed.

Authors and Affiliations

Khan Adil, Feng Jiang, Shaohui Liu, Aleksei Grigorev, B. B. Gupta, Seungmin Rho

Keywords

Related Articles

Indoor Positioning System using Regression-based Fingerprint Method

Indoor Positioning System has opportunity to be used in different business platform. Based on past research, optimized localization method for Bluetooth Low Energy (BLE) to predict position of person or object with high...

A Novel Position-based Sentiment Classification Algorithm for Facebook Comments

With the popularisation of social networks, people are now more at ease to share their thoughts, ideas, opinions and views about all kinds of topics on public platforms. Millions of users are connected each day on social...

Optimal Pragmatic Clustering for Wireless Networks

Nodes’ clustering in wireless networks is one of the solutions that used to improve network performance. This paper discusses the clustering in wireless networks. Then it presents a novel clustering algorithm named Pragm...

Analysis of Cloud Network Management Using Resource Allocation and Task Scheduling Services

Network failure in cloud datacenter could result from inefficient resource allocation; scheduling and logical segmentation of physical machines (network constraints). This is highly undesirable in Distributed Cloud Compu...

Solving Nonlinear Eigenvalue Problems using an Improved Newton Method

Finding approximations to the eigenvalues of non-linear eigenvalue problems is a common problem which arises from many complex applications. In this paper, iterative algo-rithms for finding approximations to the eigenval...

Download PDF file
  • EP ID EP251587
  • DOI 10.14569/IJACSA.2017.081205
  • Views 91
  • Downloads 0

How To Cite

Khan Adil, Feng Jiang, Shaohui Liu, Aleksei Grigorev, B. B. Gupta, Seungmin Rho (2017). Training an Agent for FPS Doom Game using Visual Reinforcement Learning and VizDoom. International Journal of Advanced Computer Science & Applications, 8(12), 32-41. https://europub.co.uk/articles/-A-251587