Any House Any Task (AHAT) is Now Public

πŸš€ Exciting News! We are thrilled to announce the release of our latest work:β€œAny House Any Task: Scalable Long-Horizon Planning for Abstract Human Tasks.” This research tackles long-horizon planning in large environments given ambiguous human instructions.

Paper Details

Title: Any House Any Task: Scalable Long-Horizon Planning for Abstract Human Tasks

Authors: Zhihong Liu, Yang Li, Renming Huang, Cewu Lu, Panpan Cai

Abstract: Open world language conditioned task planning is crucial for robots operating in large-scale household environments. While many recent works attempt to address this problem using Large Language Models (LLMs) via prompting or training, a key challenge remains scalability. Performance often degrades rapidly with increasing environment size, plan length, instruction ambiguity, and constraint complexity. In this work, we propose Any House Any Task (AHAT), a household task planner optimized for long-horizon planning in large environments given ambiguous human instructions. At its core, AHAT utilizes an LLM trained to map task instructions and textual scene graphs into grounded subgoals defined in the Planning Domain Definition Language (PDDL). These subgoals are subsequently solved to generate feasible and optimal long-horizon plans through explicit symbolic reasoning. To enhance the model’s ability to decompose complex and ambiguous intentions, we introduce TGPO, a novel reinforcement learning algorithm that integrates external correction of intermediate reasoning traces into Group Relative Policy Optimization (GRPO). Experiments demonstrate that AHAT achieves significant performance gains over state-of-the-art prompting, planning, and learning methods, particularly in human-style household tasks characterized by brief instructions but requiring complex execution plans.

We are excited to share this work with the robotics community and look forward to your feedback and potential collaborations!

Zhihong Liu
Zhihong Liu
Ph.D. student

My research interests include robotics, task planning and decision-making

Yang Li
Yang Li
Ph.D. student

My research interests include robotics, task planning and decision-making

Renming Huang
Renming Huang
Ph.D. student

My research interests include robotics, task planning and Reinforcement Learning

Panpan Cai
Panpan Cai
Associate Professor

My research interests include robot motion planning, decision making, robot learning, parallel computing, and their applications to autonomous driving in crowded environments.