Symbolic Reasoning for Hearthstone

Andreas Stiegler, K. Dahal, J. Maucher, D. Livingstone

Research output: Contribution to journalArticle

49 Downloads (Pure)

Abstract

Trading-Card-Games are an interesting problem domain for Game AI, as they feature some challenges, such as highly variable game mechanics, that are not encountered in this intensity in many other genres. We present an expert system forming a player-level AI for the digital Trading-Card-Game Hearthstone. The bot uses a symbolic approach with a semantic structure, acting as an ontology, to represent both static descriptions of the game mechanics and dynamic game-state memories. Methods are introduced to reduce the amount of expert knowledge, such as popular moves or strategies, represented in the ontology, as the bot should derive such decisions in a symbolic way from its knowledge base. We narrow down the problem domain, selecting the relevant aspects for a play-to-win bot approach and comparing an ontology-driven approach to other approaches such as machine learning and case-based reasoning. Upon this basis, we describe how the semantic structure is linked with the game-state and how different aspects, such as memories, are encoded. An example will illustrate how the bot, at runtime, uses rules and queries on the semantic structure combined with a simple utility system to do reasoning and strategic planning. Finally, an evaluation is presented that was conducted by fielding the bot against the stock “Expert” AI that Hearthstone is shipped with, as well as Human opponents of various skill levels in order to assess how well the bot plays. Evaluating how believable the bot reasons is assessed through a Pseudo-Turing test.
Original languageEnglish
Pages (from-to)1-15
Number of pages15
JournalIEEE Transactions on Computational Intelligence and AI in Games
VolumePP
Issue number99
DOIs
Publication statusPublished - 19 May 2017

Fingerprint

Ontology
Semantics
Mechanics
Data storage equipment
Strategic planning
Case based reasoning
Expert systems
Learning systems

Keywords

  • Artificial intelligence
  • Cognition
  • Electronic mail
  • Games
  • Monte Carlo methods
  • Planning
  • Runtime

Cite this

Stiegler, Andreas ; Dahal, K. ; Maucher, J. ; Livingstone, D. / Symbolic Reasoning for Hearthstone. In: IEEE Transactions on Computational Intelligence and AI in Games. 2017 ; Vol. PP, No. 99. pp. 1-15.
@article{09c2656538aa4264a72f9725348d01e4,
title = "Symbolic Reasoning for Hearthstone",
abstract = "Trading-Card-Games are an interesting problem domain for Game AI, as they feature some challenges, such as highly variable game mechanics, that are not encountered in this intensity in many other genres. We present an expert system forming a player-level AI for the digital Trading-Card-Game Hearthstone. The bot uses a symbolic approach with a semantic structure, acting as an ontology, to represent both static descriptions of the game mechanics and dynamic game-state memories. Methods are introduced to reduce the amount of expert knowledge, such as popular moves or strategies, represented in the ontology, as the bot should derive such decisions in a symbolic way from its knowledge base. We narrow down the problem domain, selecting the relevant aspects for a play-to-win bot approach and comparing an ontology-driven approach to other approaches such as machine learning and case-based reasoning. Upon this basis, we describe how the semantic structure is linked with the game-state and how different aspects, such as memories, are encoded. An example will illustrate how the bot, at runtime, uses rules and queries on the semantic structure combined with a simple utility system to do reasoning and strategic planning. Finally, an evaluation is presented that was conducted by fielding the bot against the stock “Expert” AI that Hearthstone is shipped with, as well as Human opponents of various skill levels in order to assess how well the bot plays. Evaluating how believable the bot reasons is assessed through a Pseudo-Turing test.",
keywords = "Artificial intelligence, Cognition, Electronic mail, Games, Monte Carlo methods, Planning, Runtime",
author = "Andreas Stiegler and K. Dahal and J. Maucher and D. Livingstone",
year = "2017",
month = "5",
day = "19",
doi = "10.1109/TCIAIG.2017.2706745",
language = "English",
volume = "PP",
pages = "1--15",
journal = "IEEE Transactions on Computational Intelligence and AI in Games",
issn = "1943-068X",
publisher = "IEEE",
number = "99",

}

Symbolic Reasoning for Hearthstone. / Stiegler, Andreas; Dahal, K.; Maucher, J.; Livingstone, D.

In: IEEE Transactions on Computational Intelligence and AI in Games, Vol. PP, No. 99, 19.05.2017, p. 1-15.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Symbolic Reasoning for Hearthstone

AU - Stiegler, Andreas

AU - Dahal, K.

AU - Maucher, J.

AU - Livingstone, D.

PY - 2017/5/19

Y1 - 2017/5/19

N2 - Trading-Card-Games are an interesting problem domain for Game AI, as they feature some challenges, such as highly variable game mechanics, that are not encountered in this intensity in many other genres. We present an expert system forming a player-level AI for the digital Trading-Card-Game Hearthstone. The bot uses a symbolic approach with a semantic structure, acting as an ontology, to represent both static descriptions of the game mechanics and dynamic game-state memories. Methods are introduced to reduce the amount of expert knowledge, such as popular moves or strategies, represented in the ontology, as the bot should derive such decisions in a symbolic way from its knowledge base. We narrow down the problem domain, selecting the relevant aspects for a play-to-win bot approach and comparing an ontology-driven approach to other approaches such as machine learning and case-based reasoning. Upon this basis, we describe how the semantic structure is linked with the game-state and how different aspects, such as memories, are encoded. An example will illustrate how the bot, at runtime, uses rules and queries on the semantic structure combined with a simple utility system to do reasoning and strategic planning. Finally, an evaluation is presented that was conducted by fielding the bot against the stock “Expert” AI that Hearthstone is shipped with, as well as Human opponents of various skill levels in order to assess how well the bot plays. Evaluating how believable the bot reasons is assessed through a Pseudo-Turing test.

AB - Trading-Card-Games are an interesting problem domain for Game AI, as they feature some challenges, such as highly variable game mechanics, that are not encountered in this intensity in many other genres. We present an expert system forming a player-level AI for the digital Trading-Card-Game Hearthstone. The bot uses a symbolic approach with a semantic structure, acting as an ontology, to represent both static descriptions of the game mechanics and dynamic game-state memories. Methods are introduced to reduce the amount of expert knowledge, such as popular moves or strategies, represented in the ontology, as the bot should derive such decisions in a symbolic way from its knowledge base. We narrow down the problem domain, selecting the relevant aspects for a play-to-win bot approach and comparing an ontology-driven approach to other approaches such as machine learning and case-based reasoning. Upon this basis, we describe how the semantic structure is linked with the game-state and how different aspects, such as memories, are encoded. An example will illustrate how the bot, at runtime, uses rules and queries on the semantic structure combined with a simple utility system to do reasoning and strategic planning. Finally, an evaluation is presented that was conducted by fielding the bot against the stock “Expert” AI that Hearthstone is shipped with, as well as Human opponents of various skill levels in order to assess how well the bot plays. Evaluating how believable the bot reasons is assessed through a Pseudo-Turing test.

KW - Artificial intelligence

KW - Cognition

KW - Electronic mail

KW - Games

KW - Monte Carlo methods

KW - Planning

KW - Runtime

U2 - 10.1109/TCIAIG.2017.2706745

DO - 10.1109/TCIAIG.2017.2706745

M3 - Article

VL - PP

SP - 1

EP - 15

JO - IEEE Transactions on Computational Intelligence and AI in Games

JF - IEEE Transactions on Computational Intelligence and AI in Games

SN - 1943-068X

IS - 99

ER -