A Semi-Markov Decision Model for Recognizing the Destination of a Maneuvering Agent in Real Time Strategy Games
Joint Authors
Yin, Quanjun
Yue, Shi-guang
Jiao, Peng
Zha, Yabing
Source
Mathematical Problems in Engineering
Issue
Vol. 2016, Issue 2016 (31 Dec. 2016), pp.1-12, 12 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2016-01-14
Country of Publication
Egypt
No. of Pages
12
Main Subjects
Abstract EN
Recognizing destinations of a maneuvering agent is important in real time strategy games.
Because finding path in an uncertain environment is essentially a sequential decision problem, we can model the maneuvering process by the Markov decision process (MDP).
However, the MDP does not define an action duration.
In this paper, we propose a novel semi-Markov decision model (SMDM).
In the SMDM, the destination is regarded as a hidden state, which affects selection of an action; the action is affiliated with a duration variable, which indicates whether the action is completed.
We also exploit a Rao-Blackwellised particle filter (RBPF) for inference under the dynamic Bayesian network structure of the SMDM.
In experiments, we simulate agents’ maneuvering in a combat field and employ agents’ traces to evaluate the performance of our method.
The results show that the SMDM outperforms another extension of the MDP in terms of precision, recall, and F -measure.
Destinations are recognized efficiently by our method no matter whether they are changed or not.
Additionally, the RBPF infer destinations with smaller variance and less time than the SPF.
The average failure rates of the RBPF are lower when the number of particles is not enough.
American Psychological Association (APA)
Yin, Quanjun& Yue, Shi-guang& Zha, Yabing& Jiao, Peng. 2016. A Semi-Markov Decision Model for Recognizing the Destination of a Maneuvering Agent in Real Time Strategy Games. Mathematical Problems in Engineering،Vol. 2016, no. 2016, pp.1-12.
https://search.emarefa.net/detail/BIM-1111818
Modern Language Association (MLA)
Yin, Quanjun…[et al.]. A Semi-Markov Decision Model for Recognizing the Destination of a Maneuvering Agent in Real Time Strategy Games. Mathematical Problems in Engineering No. 2016 (2016), pp.1-12.
https://search.emarefa.net/detail/BIM-1111818
American Medical Association (AMA)
Yin, Quanjun& Yue, Shi-guang& Zha, Yabing& Jiao, Peng. A Semi-Markov Decision Model for Recognizing the Destination of a Maneuvering Agent in Real Time Strategy Games. Mathematical Problems in Engineering. 2016. Vol. 2016, no. 2016, pp.1-12.
https://search.emarefa.net/detail/BIM-1111818
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1111818