Iterative Planning for Deterministic QDec-POMDPs

14 pages•Published: September 17, 2018

Abstract

QDec-POMDPs are a qualitative alternative to stochastic Dec-POMDPs for goal-oriented plan- ning in cooperative partially observable multi-agent environments. Although QDec-POMDPs share the same worst case complexity as Dec-POMDPs, previous research has shown an ability to scale up to larger domains while producing high quality plan trees. A key difficulty in distributed execution is the need to construct a joint plan tree branching on the combinations of observations of all agents. In this work, we suggest an iterative algorithm, IMAP, that plans for one agent at a time, taking into considerations collaboration constraints about action execution of previous agents, and generating new constraints for the next agents. We explain how these constraints are generated and handled, and a backtracking mechanism for changing constraints that cannot be met. We provide experimental results on multi-agent planning domains, showing our methods to scale to much larger problems with several collaborating agents and huge state spaces.

Keyphrases: contingent planning, distributed planning, multi agent planning, planning under uncertainty, pomdps

In: Daniel Lee, Alexander Steen and Toby Walsh (editors). GCAI-2018. 4th Global Conference on Artificial Intelligence, vol 55, pages 15-28.

Links:	https://easychair.org/publications/paper/zQJx
	https://doi.org/10.29007/4t8s

BibTeX entry

@inproceedings{GCAI-2018:Iterative_Planning_Deterministic_QDec,
  author    = {Sagi Bazinin and Guy Shani},
  title     = {Iterative Planning for Deterministic QDec-POMDPs},
  booktitle = {GCAI-2018. 4th Global Conference on Artificial Intelligence},
  editor    = {Daniel Lee and Alexander Steen and Toby Walsh},
  series    = {EPiC Series in Computing},
  volume    = {55},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-7340},
  url       = {/publications/paper/zQJx},
  doi       = {10.29007/4t8s},
  pages     = {15-28},
  year      = {2018}}

Download PDF Open PDF in browser