Mosaic: Runtime-Efficient Multi-Agent Embodied Planning

Generative AI & LLMs
Published: arXiv: 2607.09603v1
Authors

Kunjal Panchal Saayan Mitra Sunav Choudhary Victor Bursztyn Somdeb Sarkhel Hui Guan

Abstract

LLM-based multi-agent embodied planning remains impractical due to prohibitively high execution latency. We identify failed actions as the dominant bottleneck, stemming from two core challenges: inaccurate state tracking under partial observability and inefficient coordination that produces redundant or conflicting actions. We introduce Mosaic, a runtime-efficient multi-agent planning framework that addresses both challenges. Mosaic maintains accurate yet lightweight state tracking through agent-centric semantic memory that stores objects in relative coordinates, enabling geometric transformations and coordination. It ensures efficient coordination through Integer Linear Programming that allocates actions at every planning step, enforcing physical feasibility and inter-agent coordination constraints. Across AI2-THOR and search-and-rescue benchmarks, Mosaic achieves 27-32% faster execution, 30-33% fewer LLM calls, 25-31% fewer steps, and 4-10% points higher success rates. These results demonstrate that efficient memory and constraint-guided coordination are critical for scalable, low-latency multi-agent planning.

Paper Summary

Problem
The main problem this paper addresses is the high execution latency of Large Language Model (LLM)-based multi-agent embodied planning systems. These systems are impractical for real-world applications due to their slow performance, which is caused by failed actions during execution.
Key Innovation
The key innovation of this work is the introduction of MOSAIC (Mosaic), a runtime-efficient multi-agent planning framework that addresses the challenges of state tracking and coordination in multi-agent systems. MOSAIC maintains accurate yet lightweight state tracking through agent-centric semantic memory and ensures efficient coordination through Integer Linear Programming (ILP).
Practical Impact
This research has significant practical implications for the deployment of LLM-based multi-agent systems in embodied environments. By reducing execution latency and inference cost, MOSAIC enables more efficient and scalable multi-agent planning. This can be applied in various real-world scenarios such as collaborative search and rescue, household rearrangement, and environmental exploration. The improved coordination efficiency of MOSAIC also helps mitigate unsafe or unpredictable behavior and reduces environmental impact in shared environments.
Analogy / Intuitive Explanation
Imagine a team of robots working together to search for a lost person in a disaster-stricken area. Each robot needs to coordinate its actions with the others to efficiently search the area and find the person. However, if the robots don't have a good way to communicate and coordinate, they might end up searching the same area multiple times, wasting time and resources. MOSAIC is like a smart coordinator that helps the robots work together more efficiently by keeping track of their actions and ensuring that they don't overlap or repeat each other's work. This allows them to find the person faster and with less effort.
Paper Information
Categories:
cs.MA
Published Date:

arXiv ID:

2607.09603v1

Quick Actions