Scalable Planning and Learning for Multiagent POMDPs

Abstract

Online, sample-based planning algorithms for POMDPs have shown great promise in scaling to problems with large state spaces, but they become intractable for large action and observation spaces. This is particularly problematic in multiagent POMDPs where the action and observation space grows exponentially with the number of agents. To combat this intractability we propose a novel scalable approach based on sample-based planning and factored value functions that exploits structure present in many multiagent settings. This approach applies not only in the planning case, but also in the Bayesian reinforcement learning setting. Experimental results show that we are able to provide high quality solutions to large multiagent planning and learning problems.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2015
Accession Number
ADA615796

Entities

People

  • Christopher Amato
  • Frans A. Oliehoek

Organizations

  • Massachusetts Institute of Technology

Tags

Communities of Interest

  • Energy and Power Technologies
  • Materials and Manufacturing Processes
  • Sensors

DTIC Thesaurus Topics

  • Algorithms
  • Artificial Intelligence
  • Artificial Intelligence Computing
  • Bayesian Networks
  • Computational Complexity
  • Computational Science
  • Computers
  • Learning
  • Machine Learning
  • Multiagent Systems
  • Neural Networks
  • Observation
  • Probability
  • Reinforcement Learning
  • Sequential Monte Carlo Methods
  • Simulations
  • Statistics

Fields of Study

  • Computer science

Readers

  • Statistical inference.
  • Systems Analysis and Design
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Machine Learning Algorithms
  • Space
  • Space - Spacecraft Maneuvers