What Is the Model in Model‐Based Planning?

Abstract

Flexibility is one of the hallmarks of human problem‐solving. In everyday life, people adapt to changes in common tasks with little to no additional training. Much of the existing work on flexibility in human problem‐solving has focused on how people adapt to tasks in new domains by drawing on solutions from previously learned domains. In real‐world tasks, however, humans must generalize across a wide range of within‐domain variation. In this work we argue that representational abstraction plays an important role in such within‐domain generalization. We then explore the nature of this representational abstraction in realistically complex tasks like video games by demonstrating how the same model‐based planning framework produces distinct generalization behaviors under different classes of task representation. Finally, we compare the behavior of agents with these task representations to humans in a series of novel grid‐based video game tasks. Our results provide evidence for the claim that within‐domain flexibility in humans derives from task representations composed of propositional rules written in terms of objects and relational categories.

Document Details

Document Type
Pub Defense Publication
Publication Date
Jan 01, 2021
Source ID
10.1111/cogs.12928

Entities

People

  • Pedro Tsividis
  • Samuel J Gershman
  • Thomas Pouncy

Organizations

  • Google
  • Harvard University
  • Massachusetts Institute of Technology
  • National Science Foundation
  • Office of Naval Research

Tags

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Computational Linguistics