TY - GEN
T1 - "Did You Hear That?" Learning to play video games from audio cues
AU - Gaina, Raluca D.
AU - Stephenson, Matthew
PY - 2019/8
Y1 - 2019/8
N2 - Game-playing AI research has focused for a long time on learning to play video games from visual input or symbolic information. However, humans benefit from a wider array of sensors which we utilise in order to navigate the world around us. In particular, sounds and music are key to how many of us perceive the world and influence the decisions we make. In this paper, we present initial experiments on game-playing agents learning to play video games solely from audio cues. We expand the Video Game Description Language to allow for audio specification, and the General Video Game AI framework to provide new audio games and an API for learning agents to make use of audio observations. We analyse the games and the audio game design process, include initial results with simple Q-Learning agents, and encourage further research in this area.
AB - Game-playing AI research has focused for a long time on learning to play video games from visual input or symbolic information. However, humans benefit from a wider array of sensors which we utilise in order to navigate the world around us. In particular, sounds and music are key to how many of us perceive the world and influence the decisions we make. In this paper, we present initial experiments on game-playing agents learning to play video games solely from audio cues. We expand the Video Game Description Language to allow for audio specification, and the General Video Game AI framework to provide new audio games and an API for learning agents to make use of audio observations. We analyse the games and the audio game design process, include initial results with simple Q-Learning agents, and encourage further research in this area.
KW - Game playing
KW - AI and games
KW - audio cues in gaming
KW - Video Game Description Language
KW - audio specification
KW - audio games
UR - http://www.scopus.com/inward/record.url?scp=85073103137&partnerID=8YFLogxK
U2 - 10.1109/CIG.2019.8848088
DO - 10.1109/CIG.2019.8848088
M3 - Conference contribution
AN - SCOPUS:85073103137
SN - 9781728118857
T3 - IEEE Conference on Computatonal Intelligence and Games, CIG
BT - IEEE Conference on Games 2019, CoG 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 IEEE Conference on Games, CoG 2019
Y2 - 20 August 2019 through 23 August 2019
ER -