LLM-Planning-Papers

Must-Read Papers on the Planning ability of Large Language Models (LLMs).

---

🏷️ News

• 2023-08-12 We create this paper list on LLM Planning .

🗞️ Papers

1. Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents

   Wenlong Huang, Pieter Abbeel, Deepak Pathak, Igor Mordatch. [abs], [code], ICML 2022

2. Least-to-Most Prompting Enables Complex Reasoning in Large Language Models

   Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc Le, Ed Chi. [abs], ICLR 2023

3. On Grounded Planning for Embodied Tasks with Language Models

   Bill Yuchen Lin, Chengsong Huang, Qian Liu, Wenda Gu, Sam Sommerer, Xiang Ren. [abs], [code], AAAI 2023

4. On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark

   Karthik Valmeekam, S. Sreedharan, Matthew Marquez, Alberto Olmo Hernandez, Subbarao Kambhampati. [abs], NeurIPS 2023

5. LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models

   Chan Hee Song, Jiaman Wu, Clayton Washington, Brian M. Sadler, Wei-Lun Chao, Yu Su. [abs], [code], ICCV 2023

6. Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents

   Zihao Wang, Shaofei Cai, Anji Liu, Xiaojian Ma, Yitao Liang. [abs], [code], NeurIPS 2023

7. Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models

   Lei Wang, Wanyu Xu, Yihuai Lan, Zhiqiang Hu, Yunshi Lan, Roy Ka-Wei Lee, Ee-Peng Lim. [abs], [code], ACL 2023.5

8. Large Language Models as Commonsense Knowledge for Large-Scale Task Planning

   Zirui Zhao Wee Sun Lee David Hsu. [abs], NeurIPS 2023.5

9. Multimodal Procedural Planning via Dual Text-Image Prompting

   Yujie Lu, Pan Lu, Zhiyu Chen, Wanrong Zhu, Xin Eric Wang, William Yang Wang. [abs], [code], Preprint 2023.5

10. LLM+P: Empowering Large Language Models with Optimal Planning Proficiency

    Bo Liu, Yuqian Jiang, Xiaohan Zhang, Qiang Liu, Shiqi Zhang, Joydeep Biswas, Peter Stone. [abs], [code], Preprint 2023.5

11. Tree of Thoughts: Deliberate Problem Solving with Large Language Models

    Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan. [abs], [code], Preprint 2023.5

12. PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents

    Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer. [abs], [code], Preprint 2023.5

13. Reasoning with Language Model is Planning with World Model

    Shibo Hao, Yilan Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, D. Wang, Zhiting Hu. [abs], [code], Preprint 2023.5

14. Understanding the Capabilities of Large Language Models for Automated Planning

    Vishal Pallagani, Bharath Muppasani, K. Murugesan, F. Rossi, Biplav Srivastava, L. Horesh, F. Fabiano, Andrea Loreggia. [abs], Preprint 2023.5

15. Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning

    Vishal Pallagani, Bharath Muppasani, K. Murugesan, F. Rossi, Biplav Srivastava, L. Horesh, F. Fabiano, Andrea Loreggia. [abs], [code], Preprint 2023.5

16. AdaPlanner: Adaptive Planning from Feedback with Language Models

    Haotian Sun, Yuchen Zhuang, Lingkai Kong, Bo Dai, Chao Zhang. [abs], [code], Preprint 2023.5

17. A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis

    Izzeddin Gur , Hiroki Furuta , Austin Huang , Mustafa Safdari , Yutaka Matsuo , Douglas Eck , Aleksandra Faust. [abs], Preprint 2023.7

18. MetaGPT: Meta Programming for Multi-Agent Collaborative Framework

    Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu. [abs], [code], Preprint 2023.8

19. Dynamic Planning with a LLM

    Gautier Dagan, Frank Keller, Alex Lascarides. [abs], Preprint 2023.8

20. TPTU: Task Planning and Tool Usage of Large Language Model-based AI Agents

    Jingqing Ruan, Yihong Chen, Bin Zhang, Zhiwei Xu, Tianpeng Bao, Guoqing Du, Shiwei Shi, Hangyu Mao, Xingyu Zeng, Rui Zhao. [abs], Preprint 2023.8

21. CodePlan: Repository-level Coding using LLMs and Planning

    Ramakrishna Bairi , Atharv Sonwane , Aditya Kanade , Vageesh D C , Arun Iyer , Suresh Parthasarathy , Sriram Rajamani , B. Ashok , Shashank Shet. [abs], Preprint 2023.9

22. Compositional Foundation Models for Hierarchical Planning

    Anurag Ajay , Seungwook Han , Yilun Du , Shaung Li , Abhi Gupta , Tommi Jaakkola , Josh Tenenbaum , Leslie Kaelbling , Akash Srivastava , Pulkit Agrawal. [abs], NeurIPS 2023

23. VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planning

    Han Lin , Abhay Zala , Jaemin Cho , Mohit Bansal. [abs], Preprint 2023.9

24. Evaluating Cognitive Maps and Planning in Large Language Models with CogEval

    Ida Momennejad , Hosein Hasanbeig , Felipe Vieira , Hiteshi Sharma , Robert Osazuwa Ness , Nebojsa Jojic , Hamid Palangi , Jonathan Larson. [abs], Preprint 2023.9.

25. Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoning

    Mohamed Aghzal, Erion Plaku, Ziyu Yao. [abs], Preprint 2023.10

26. Tree-Planner: Efficient Close-loop Task Planning with Large Language Models

    Mengkang Hu, Yao Mu, Xinmiao Yu, Mingyu Ding, Shiguang Wu, Wenqi Shao, Qiguang Chen, Bin Wang, Yu Qiao, Ping Luo. [abs], NeurIPS 2023.

27. Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction Arena

    Jiangjie Chen, Siyu Yuan, Rong Ye, Bodhisattwa Prasad Majumder, Kyle Richardson. [abs], Preprint 2023.9

28. Guiding Language Model Reasoning with Planning Tokens

    Xinyi Wang, Lucas Caccia, Oleksiy Ostapenko, Xingdi Yuan, Alessandro Sordoni. [abs], Preprint 2023.9

29. Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models

    Andy Zhou, Kai Yan, Michal Shlapentokh-Rothman, Haohan Wang, Yu-Xiong Wang. [abs], Preprint 2023.10

30. Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planning

    Dhruv Shah, Michael Equi, Blazej Osinski, Fei Xia, Brian Ichter, Sergey Levine. [abs], Preprint 2023.10

31. Interactive Task Planning with Language Models

    Boyi Li, Philipp Wu, Pieter Abbeel, Jitendra Malik. [abs], Preprint 2023.10

32. BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biology

    Odhran O'Donoghue, Aleksandar Shtedritski, John Ginger, Ralph Abboud, Ali Essa Ghareeb, Justin Booth, Samuel G Rodriques. [abs], EMNLP 2023

33. DiagrammerGPT: Generating Open-Domain, Open-Platform Diagrams via LLM Planning

    Abhay Zala, Han Lin, Jaemin Cho, Mohit Bansal. [abs], Preprint 2023.10

34. PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization

    Xinyuan Wang, Chenxi Li, Zhen Wang, Fan Bai, Haotian Luo, Jiayou Zhang, Nebojsa Jojic, Eric P. Xing, Zhiting Hu. [abs], Preprint 2023.10

35. Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents

    Yang Deng, Wenxuan Zhang, Wai Lam, See-Kiong Ng, Tat-Seng Chua. [openreview], ICLR 2024

36. PlaSma: Procedural Knowledge Models for Language-based Planning and Re-Planning

    Faeze Brahman, Chandra Bhagavatula, Valentina Pyatkin, Jena D. Hwang, Xiang Lorraine Li, Hirona Jacqueline Arai, Soumya Sanyal, Keisuke Sakaguchi, Xiang Ren, Yejin Choi. [openreview], ICLR 2024

37. Agent Planning with World Knowledge Model

    Shuofei Qiao, Runnan Fang, Ningyu Zhang, Yuqi Zhu, Xiang Chen, Shumin Deng, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen. [abs], 2024.05

⭐ Star History