In the Driver's Seat: A Multi-Company Study on the Reality of Autonomous Driving System Testing

Hugging Face Daily Papers Papers
autonomous-driving testing multi-company-study scenario-based closed-loop system-testing

Summary

An interview-based study across nine companies in six countries examining current autonomous driving system testing practices, challenges, and future trends, proposing an evidence-centered closed-loop testing framework.

Autonomous driving systems (ADS) are rapidly advancing and increasingly deployed in real-world applications. This creates growing demands for effective testing to ensure system functionality and safety. However, ADS testing remains complex and lacks well-established standards for scenario selection, performance evaluation, and acceptance criteria. To better understand current ADS testing practices and challenges, we conducted an interview study with experts working on ADS development and testing in nine companies from six different countries. Through thematic analysis, we synthesized industrial testing practices, challenges, potential solutions, future trends, and proposed an evidence-centered closed-loop testing framework for ADS testing. Our findings show that current practices primarily focus on scenario-based and X-in-the-loop testing approaches, supported by diverse tools, metrics, benchmarks, and testing strategies. The participants highlighted major challenges related to scenario realism, scenario coverage, simulation fidelity, and acceptance criteria, while also discussing potential solutions such as the use of AI, world models, and end-to-end approaches. Furthermore, participants envisioned future ADS testing to become more automated, data-driven, and transparent across the industry. Overall, this study provides a comprehensive industry-grounded overview of ADS testing, proposes an evidence-centered closed-loop testing framework to provide actionable guidance for ADS testing, and outlines important directions for future research and practice.
Original Article
View Cached Full Text

Cached at: 08/03/26, 09:31 AM

Paper page - In the Driver’s Seat: A Multi-Company Study on the Reality of Autonomous Driving System Testing

Source: https://huggingface.co/papers/2607.15820

Abstract

Autonomousdrivingsystems(ADS)arerapidlyadvancingandincreasinglydeployedinreal-worldapplications.Thiscreatesgrowingdemandsforeffectivetestingtoensuresystemfunctionalityandsafety.However,ADStestingremainscomplexandlackswell-establishedstandardsforscenarioselection,performanceevaluation,andacceptancecriteria.TobetterunderstandcurrentADStestingpracticesandchallenges,weconductedaninterviewstudywithexpertsworkingonADSdevelopmentandtestinginninecompaniesfromsixdifferentcountries.Throughthematicanalysis,wesynthesizedindustrialtestingpractices,challenges,potentialsolutions,futuretrends,andproposedanevidence-centeredclosed-looptestingframeworkforADStesting.Ourfindingsshowthatcurrentpracticesprimarilyfocusonscenario-basedandX-in-the-looptestingapproaches,supportedbydiversetools,metrics,benchmarks,andtestingstrategies.Theparticipantshighlightedmajorchallengesrelatedtoscenariorealism,scenariocoverage,simulationfidelity,andacceptancecriteria,whilealsodiscussingpotentialsolutionssuchastheuseofAI,worldmodels,andend-to-endapproaches.Furthermore,participantsenvisionedfutureADStestingtobecomemoreautomated,data-driven,andtransparentacrosstheindustry.Overall,thisstudyprovidesacomprehensiveindustry-groundedoverviewofADStesting,proposesanevidence-centeredclosed-looptestingframeworktoprovideactionableguidanceforADStesting,andoutlinesimportantdirectionsforfutureresearchandpractice.

View arXiv pageView PDFAdd to collection

Get this paper in your agent:

hf papers read 2607\.15820

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2607.15820 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2607.15820 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2607.15820 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

DriveZero: End-to-End Driving Beyond Human Demonstrations

Hugging Face Daily Papers

DriveZero is an end-to-end autonomous driving system that combines a vision foundation model for perception with reinforcement learning for action, achieving driving behaviors beyond human demonstrations and state-of-the-art performance on benchmarks like nuPlan and NAVSIM.