Learning Qualitative Models by Demonstration

Thomas R Hinrichs, Kenneth D. Forbus

Research output: Contribution to conferencePaperpeer-review

1 Scopus citations

Abstract

Creating software agents that learn interactively requires the ability to learn from a small number of trials, extracting general, flexible knowledge that can drive behavior from observation and interaction. We claim that qualitative models provide a useful intermediate level of causal representation for dynamic domains, including the formulation of strategies and tactics. We argue that qualitative models are quickly learnable, and enable model based reasoning techniques to be used to recognize, operationalize, and construct more strategic knowledge. This paper describes an approach to incrementally learning qualitative influences by demonstration in the context of a strategy game. We show how the learned model can help a system play by enabling it to explain which actions could contribute to maximizing a quantitative goal. We also show how reasoning about the model allows it to reformulate a learning problem to address delayed effects and credit assignment, such that it can improve its performance on more strategic tasks such as city placement.

Original languageEnglish (US)
Pages207-213
Number of pages7
StatePublished - 2012
Event26th AAAI Conference on Artificial Intelligence, AAAI 2012 - Toronto, Canada
Duration: Jul 22 2012Jul 26 2012

Conference

Conference26th AAAI Conference on Artificial Intelligence, AAAI 2012
Country/TerritoryCanada
CityToronto
Period7/22/127/26/12

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Learning Qualitative Models by Demonstration'. Together they form a unique fingerprint.

Cite this