Fuzzy Q-Learning for first person shooters

Youssef S.G. Nashed, Darryl N. Davis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Here machine learning techniques in the context of their application within computer games is examined. The scope of the study was that of reinforcement learning [RL] algorithms as applied to the control of enemies in a video game dynamic environment thus providing interesting new experiences for different game players. The project proved reinforcement learning algorithms are suitable and useful for simulating intelligence of agents within a game. The implemented learning bot exhibited interesting capabilities to adapt to a human player playing style in addition to outperforming other implemented and downloaded bots. Test results showed that incorporating learning into a game can reduce the extensive scripting and tuning phase, while retaining the ability to guide the NPCs not to exhibit totally unrealistic or unexpected behaviors. This gives the designers the scope to explore new strategies. The effect of the exploration-exploitation policy on the learning convergence was studied and tested in depth. The combination of the two most popular reinforcement algorithms [Q-Learning and TD(λ)] resulted in faster learning rates and realistic behavior through the exploration period.

Original languageEnglish (US)
Title of host publication12th Middle Eastern Simulation and Modelling Multiconference, MESM 2011 - 2nd GAMEON-ARABIA Conference, GAMEON-ARABIA 2011
PublisherEUROSIS
Pages149-156
Number of pages8
StatePublished - Jan 1 2011
Event12th Middle Eastern Simulation and Modelling Multiconference, MESM 2011 - 2nd GAMEON-ARABIA Conference, GAMEON-ARABIA 2011 - Amman, Jordan
Duration: Nov 14 2011Nov 16 2011

Other

Other12th Middle Eastern Simulation and Modelling Multiconference, MESM 2011 - 2nd GAMEON-ARABIA Conference, GAMEON-ARABIA 2011
CountryJordan
CityAmman
Period11/14/1111/16/11

Keywords

  • First Person Shooters
  • Fuzzy Systems
  • Q-Learning
  • Quake-II
  • Reinforcement Learning

ASJC Scopus subject areas

  • Modeling and Simulation

Fingerprint Dive into the research topics of 'Fuzzy Q-Learning for first person shooters'. Together they form a unique fingerprint.

Cite this