Bridging the Evaluation Gap: Standardized Benchmarks for Multi-Objective Search

Computer Science > Artificial Intelligence [Submitted on 25 Mar 2026] Bridging the Evaluation Gap: Standardized Benchmarks for Multi-Objective Search Hadar Peer, Carlos Hernandez, Sven Koenig, Ariel Felner, Oren Salzman Empirical evaluation in multi-objective search (MOS) has historically suffered from fragmentation, relying on heterogeneous problem instances with incompatible objective definitions that make cross-study comparisons difficult. This standardization gap is further exacerbated by the realization that DIMACS road networks, a historical default benchmark for the field, exhibit highly correlated objectives that fail to capture diverse Pareto-front structures. To address this, we introduce the first comprehensive, standardized benchmark suite for exact and approximate MOS. Our suite spans four structurally diverse domains: real-world road networks, structured synthetic graphs, game-based grid environments, and high-dimensional robotic motion-planning roadmaps. By providing fixed graph instances, standardized start-goal queries, and both exact and approximate reference Pareto-optimal solution sets, this suite captures a full spectrum of objective interactions: from strongly correlated to strictly independent. Ultimately, this benchmark provides a common foundation to ensure future MOS evaluations are robust, reproducible, and structurally comprehensive. Subjects: Artificial Intelligence (cs.AI) Cite as: arXiv:2603.24084 [cs.AI]   (or arXiv:2603.24084v1 [cs.AI] for this version)   https://doi.org/10.48550/arXiv.2603.24084 Focus to learn more Submission history From: Hadar Peer [view email] [v1] Wed, 25 Mar 2026 08:45:33 UTC (4,381 KB) Access Paper: HTML (experimental) view license Current browse context: cs.AI < prev   |   next > new | recent | 2026-03 Change to browse by: cs References & Citations NASA ADS Google Scholar Semantic Scholar Export BibTeX Citation Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Demos Related Papers About arXivLabs Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)