A complementary study on PlanGPT: Evaluation with defined Performance Metrics and comparison with a planner

Computer Science > Artificial Intelligence [Submitted on 9 Jun 2026] A complementary study on PlanGPT: Evaluation with defined Performance Metrics and comparison with a planner Youssef Abdelkader, Humbert Fiorino, Damien Pellier Automated Planning is a subfield of Artificial Intelligence (AI) where the main objective is generating a sequence of actions, known as a plan, that helps us reach a goal state from an initial state. A planning problem is defined by a set of objects, an initial state and a desired goal state. The objective is to compute a plan that'll lead us from the inital state to the goal state. Programs that generate plans are called planners. In this paper, we did a complementary study to the state-of-the-art LLM called PlanGPT which was released last year. We redid some experiments to verify whether planning with LLMs is \textbf{pertinent} and \textbf{worthwhile}. We also check whether the results obtained in the official PlanGPT paper for plan coverage were correct, and we also performed a more comprehensive study on PlanGPT's performance: in our paper PlanGPT's performance was evaluated using two metrics: Plan Cost and Plan Generation Time. The results of planGPT were compared to those produced by a traditional planner for the same plans and same metrics. We discovered that PlanGPT is no better than a Greedy search strategy. Comments: 7 pages Subjects: Artificial Intelligence (cs.AI) Cite as: arXiv:2606.10489 [cs.AI]   (or arXiv:2606.10489v1 [cs.AI] for this version)   https://doi.org/10.48550/arXiv.2606.10489 Focus to learn more Submission history From: Damien Pellier [view email] [v1] Tue, 9 Jun 2026 07:07:48 UTC (277 KB) Access Paper: HTML (experimental) view license Current browse context: cs.AI < prev   |   next > new | recent | 2026-06 Change to browse by: cs References & Citations NASA ADS Google Scholar Semantic Scholar Export BibTeX Citation Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Demos Related Papers About arXivLabs Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)