在寄存器上驾驶,在风险上推理:面向基于寄存器的端到端自动驾驶的风险感知占用表示
摘要
本文提出RRDrive,一种用于基于寄存器的端到端自动驾驶的风险感知占用表示,该表示在复杂场景中改进了轨迹预测和选择,取得了显著的性能提升。
arXiv:2609.21486v1 Announce Type: new
Abstract: Multimodal trajectory prediction improves behavioral coverage in end-to-end autonomous driving, but existing methods remain limited by sparse scene representations. Incomplete evidence leads to low-quality candidate generation and unreliable ranking among geometrically similar trajectories. On a register-based baseline, bad and poor candidates constitute 19.74% of the candidate set, while the oracle-best candidate ranks only 33.9th on average. We propose RRDrive, which introduces risk-aware occupancy as a dense, temporally aligned, and trajectory-queryable representation. Its global structure guides high-quality multimodal generation, while candidate-conditioned risk queries support fine-grained selection. We further construct RiskOcc4D-NAVSIM with automatic risk annotations. RRDrive achieves a selected-trajectory PDMS of 0.951, representing a 1.5% relative improvement over the baseline (0.937), and improves the average candidate PDMS by 7.7%. In challenging scenes, it improves candidate PDMS by 30.2% and increases the Spearman correlation among good candidates by 0.41, from 0.26 to 0.67. To move beyond this oracle setting, we further develop an external RiskOcc predictor, a perception module that estimates risk-aware occupancy directly from sensor inputs. The competitive performance validates the representation's feasibility.
查看缓存全文
缓存时间: 2026/09/21 09:24
# Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving
Source: [https://arxiv.org/html/2609.21486](https://arxiv.org/html/2609.21486)
Hengduo ZouYukai QinYiren ZhaoLidong Yu Bolin Gao††thanks:$†$ Corresponding author: Bolin Gao
###### Abstract
Multimodal trajectory prediction improves behavioral coverage in end\-to\-end autonomous driving, but existing methods remain limited by sparse scene representations\. Incomplete evidence leads to low\-quality candidate generation and unreliable ranking among geometrically similar trajectories\. On a register\-based baseline, bad and poor candidates constitute 19\.74% of the candidate set, while the oracle\-best candidate ranks only 33\.9th on average\. We propose RRDrive, which introduces risk\-aware occupancy as a dense, temporally aligned, and trajectory\-queryable representation\. Its global structure guides high\-quality multimodal generation, while candidate\-conditioned risk queries support fine\-grained selection\. We further construct RiskOcc\-NAVSIM with automatic risk annotations\. RRDrive achieves a selected\-trajectory PDMS of0\.951, representing a 1\.5% relative improvement over the baseline \(0\.937\), and improves the average candidate PDMS by 7\.7%\. In challenging scenes, it improves candidate PDMS by 30\.2% and increases the Spearman correlation among good candidates by 0\.41, from 0\.26 to 0\.67\. To move beyond this oracle setting, we further develop an external RiskOcc predictor, a perception module that estimates risk\-aware occupancy directly from sensor inputs\. The competitive performance validates the representation’s feasibility\.
1School of Vehicle and Mobility, Tsinghua University
2The Hong Kong University of Science and Technology \(Guangzhou\)
3Neolix, Beijing, China
## Introduction
End\-to\-end autonomous driving must produce a single executable trajectory from uncertain observations\. Multimodal trajectory prediction improves robustness by preserving multiple plausible driving behaviors before final selection\. However, existing methods still suffer from low\-quality candidate generation and unreliable trajectory ranking\. We argue that these failures are not inherent to multimodality, but largely stem from sparse scene representations\. Agent\- and map\-based features provide compact structural information, yet omit continuous evidence about unstructured obstacles, road boundaries, uncertain regions, and future interactions\. Consequently, they provide insufficient global guidance for candidate generation and inadequate local risk evidence for a risk\-aware selector\.
Figure 1:Motivation and overall performance of RRDrive\. Register\-based baselines face both candidate generation waste and ranking errors in complex scenes, driven by unmodeled local future risks\. Left: Multi\-view inputs and temporal evolution of risk\-aware occupancy\. Right: Trajectory comparison and quantitative improvements validate our dense trajectory\-queryable risk representation\.We analyze this limitation on baseline, a register\-based planner with separate trajectory generation and scoring\([Kirby et al\. 2026](https://arxiv.org/html/2609.21486#bib.bib22)\)\. As shown in Figure[1](https://arxiv.org/html/2609.21486#Sx1.F1), a single complex driving scene exhibits two coupled failure modes\. The generator outputs abundant unsafe, off\-route, or ineffective candidates that exhaust the limited candidate budget\. Meanwhile, geometrically similar good trajectories form dense bundles; their ground\-truth oracle PDMS differs from localized future risks, leading to mis\-ranking by the predicted scorer\. A missing good candidate cannot be recovered by the scorer, while incorrect ranking discards already\-available high\-quality solutions\. These observations suggest that multimodal generator\-selector architectures require a dense representation supporting both global risk reasoning and trajectory\-specific evaluation\.
The risk\-aware occupancy, an explicit, dense, and trajectory\-queryable representation in the ego\-centric BEV form, proposed by\([Chen et al\. 2024a](https://arxiv.org/html/2609.21486#bib.bib30)\)\. It unifies map\-derived static risks and dynamic occupancy risks within a common field\. Its global structure exposes feasible and hazardous regions, enabling the generator to allocate candidates toward high\-quality behaviors\. Its local values can be queried along each trajectory to form a candidate\-specific risk profile, revealing differences in collision exposure, road\-boundary risk, and future interactions\. Risk\-aware occupancy therefore provides the complementary information required for both candidate generation and fine\-grained selection\.
Building upon this representation, we present a Risk\-Register E2E framework driven by global\-local risk\-aware occupancy cues \(RRDrive\) \(Figure[2](https://arxiv.org/html/2609.21486#Sx1.F2)\), a multimodal end\-to\-end planner featuring global risk fusion and trajectory\-conditioned risk extraction\. Global risk fusion incorporates the complete risk field into scene features to improve candidate generation\. Trajectory\-conditioned extraction samples local risks along each proposal and augments the scorer with explicit risk evidence\. We further introduce a risk\-aware occupancy prediction branch to estimate the representation from sensor inputs\. Because existing datasets do not provide the required supervision, we develop an automatic annotation pipeline and construct RiskOcc\-NAVSIM\. We also adopt targeted metrics to separately evaluate candidate quality and ranking reliability\.
Experiments on NAVSIM show that RRDrive improves both capabilities\. It raises the overall average candidate PDMS from 0\.797 to 0\.858 and the selected\-trajectory PDMS from 0\.9367 to 0\.9506\. In generation\-challenging scenes, the average candidate PDMS increases from 0\.5395 to 0\.7026, while the proportion of good candidates rises from 50\.13% to 69\.76%\. In selection\-challenging scenes, the Spearman correlation among good candidates improves from 0\.2646 to 0\.6745, and oracle\-best recall increases from 3\.62% to 24\.86%\. These results demonstrate that explicit risk representation improves both multimodal trajectory quality and best\-trajectory selection\.
The main contributions are summarized as follows:
- •We identify compact scene register representation as the shared bottleneck of multimodal trajectory generation and selection, and exploit risk\-aware occupancy for global\-local collaborative reasoning: global risk guides feasible candidate allocation, while trajectory\-conditioned local risk queries offer discriminative cues for ranking geometrically similar trajectories\.
- •We propose RRDrive, a register\-based end\-to\-end driving architecture that integrates risk\-conditioned candidate generation and trajectory\-conditioned risk\-aware selection\. It substantially improves candidate\-pool quality and ranking fidelity, yielding consistent gains in challenging interactive scenarios\.
- •We build RiskOcc4D\-NAVSIM by automated annotation of NAVSIM to furnish ground\-truth supervision and an evaluation testbed for risk\-aware occupancy\. We further develop an external RiskOcc predictor producing lossy risk maps from sensor inputs to validate pipeline robustness under non\-oracle perceptual conditions\.
Figure 2:Overall architecture of RRDrive\. A risk tokenizer encodes BEV risk\-aware occupancy, which is fused with camera scene tokens for risk\-conditioned candidate generation and read out along each candidate trajectory for risk\-aware selection\.
## Related Work
Existing end\-to\-end autonomous driving planners fall into three paradigms by trajectory candidate construction and selection: deterministic point estimation, discrete hypothesis scoring, and continuous distribution modeling\. Each has clear performance trade\-offs and inherent flaws\. We take the practical discrete candidate scoring paradigm as baseline, targeting its core defect: implicit modeling of scene\-trajectory matching\. Represented by UniAD\([Hu et al\. 2023](https://arxiv.org/html/2609.21486#bib.bib1)\)and TransFuser\([Chitta et al\. 2022](https://arxiv.org/html/2609.21486#bib.bib29)\), deterministic single\-trajectory regression adopts end\-to\-end networks with behavior cloning to output one trajectory per forward pass\. Simple, low\-latency and multi\-task trainable, it fits real\-time onboard deployment\. Yet it frames planning as point estimation and cannot preserve multiple multimodal feasible trajectories\. In interactive scenarios with diverse plausible maneuvers, it outputs averaged, conservative suboptimal trajectories with weak decision diversity and poor long\-tail robustness\.
Discrete candidate generation with learnable scoring \(VADv2\([Jiang et al\. 2026](https://arxiv.org/html/2609.21486#bib.bib2)\), SparseDrive\([Sun et al\. 2024](https://arxiv.org/html/2609.21486#bib.bib32)\)\) produces discrete trajectory candidates via sparse queries and structured anchors, then ranks trajectories via a dedicated scoring network\. It resolves the diversity deficit of single\-trajectory regression and avoids generative models’ iterative sampling cost, balancing multi\-hypothesis reasoning and fast inference\. Its key bottleneck lies in globally compressed implicit scene features for trajectory evaluation: candidate\-environment and interaction boundary matching is only implicitly inferred without explicit modeling or precise querying\. This yields abundant low\-quality redundant samples and unstable fine\-grained ranking among similar high\-quality trajectory candidates, capping performance in complex interactive scenarios\.
Generative sampling with Best\-of\-N selection \(DiffusionDrive\([Liao et al\. 2025](https://arxiv.org/html/2609.21486#bib.bib4)\), GoalFlow\([Xing et al\. 2025](https://arxiv.org/html/2609.21486#bib.bib20)\), TrajFlow\([Li et al\. 2026b](https://arxiv.org/html/2609.21486#bib.bib21)\)\) learns scene\-conditioned continuous trajectory distributions to break discrete candidates’ expressiveness limits, generating highly diverse, scene\-wide trajectory samples better suited to long\-tail complex interactions\. DiffusionDrive leverages anchor priors and truncated diffusion sampling to cut sampling costs while enabling multimodal trajectories\. Still, iterative sampling brings heavy inference overhead incompatible with onboard real\-time demands; random sampling lacks stability, and trajectory quality heavily relies on post\-hoc scoring\. Without explicit spatiotemporal environmental constraints, Best\-of\-N filtering fails to accurately distinguish near\-identical high\-quality candidates, hurting deployment stability\.
## Method
Figure[2](https://arxiv.org/html/2609.21486#Sx1.F2)gives an overview of RRDrive\. On top of a register\-based generator–selector planner, risk\-aware occupancy enters through two pathways: a risk\-conditioned generation module that fuses the global risk field into scene features to steer candidate generation, and a risk\-aware selection module that reads the field along each candidate to sharpen ranking\. A label\-construction pipeline supplies theF ground\-truth risk representation for training, and an external predictor estimates it from sensors for sensor\-only inference\. The four subsections below detail these components in turn\.
### Risk\-Conditioned Candidate Generation
A finite budget spent on unsafe or off\-route proposals sets a quality floor that no downstream scorer can recover, so this module makes scene\-level risk explicit and conditions candidate generation on it\. The framework represents planning as scoring a finite candidate set𝒯=\{τi\}i=1N\\mathcal\{T\}=\\\{\\tau\_\{i\}\\\!\\\}\_\{i=1\}^\{N\}, where each proposalτi=\(xi,t,yi,t,θi,t\)t=1Tp\\tau\_\{i\}=\(x\_\{i,t\},\\\!y\_\{i,t\},\\\!\\theta\_\{i,t\}\)\_\{t=1\}^\{T\_\{p\}\}is an ego\-centric future trajectory\. In the original design, candidates come from visual scene tokens and trajectory features alone; because this implicit representation cannot separate feasible regions from hazardous ones, the budget leaks toward such proposals, which the explicit RiskOcc field is designed to prevent\. Figure[3](https://arxiv.org/html/2609.21486#Sx3.F3)illustrates this module\.
Figure 3:RiskOcc\-conditioned candidate generation module\. Risk tokens and camera scene tokens are combined by bidirectional cross\-attention with LayerScale gating, and the fused context conditions the trajectory decoder so that the finite candidate budget is steered toward feasible, high\-quality behaviors\.We use BEV risk\-aware occupancyℛ=\{Rs,\{Rtd\}t=1Tr,Rl\}\\mathcal\{R\}=\\\{R^\{s\},\\\!\\\{R^\{d\}\_\{t\}\\\!\\\}\_\{t=1\}^\{T\_\{r\}\},\\\!R^\{l\}\\\}, whereRs∈ℝH×WR^\{s\}\\in\\mathbb\{R\}^\{H\\\!\\times\\\!W\}is global scene RiskOcc,Rtd∈ℝCd×H×WR^\{d\}\_\{t\}\\in\\mathbb\{R\}^\{C\_\{d\}\\\!\\times\\\!H\\\!\\times\\\!W\}is time\-indexed dynamic risk with velocity cues, andRl∈ℝH×WR^\{l\}\\in\\mathbb\{R\}^\{H\\\!\\times\\\!W\}is lane\-boundary risk, all in the trajectory frame\. Rather than a handcrafted cost map,ℛ\\mathcal\{R\}is encoded into a compact token set by a risk tokenizerℰϕ\\mathcal\{E\}\_\{\\phi\},
Zr=ℰϕ\(Concat\(Rs,\{Rtd\}t,Rl\)\)∈ℝK×D,Z\_\{r\}=\\mathcal\{E\}\_\{\\phi\}\\\!\\big\(\\textnormal\{Concat\}\(R^\{s\},\\\!\\\{R^\{d\}\_\{t\}\\\!\\\}\_\{t\},\\\!R^\{l\}\)\\big\)\\in\\mathbb\{R\}^\{K\\\!\\times\\\!D\},\(1\)built from a convolutional BEV stem with coordinate\-aware priors, residual channel reweighting, and Perceiver\-style cross\-attention ontoKKlearnable queries, preserving safety\-critical local cues\.
Given camera scene tokensZcZ\_\{c\}, a risk\-aware context is formed by bidirectional cross\-attentionCA\(⋅,⋅\)\\mathrm\{CA\}\(\\cdot,\\cdot\),
Z~c\\displaystyle\\tilde\{Z\}\_\{c\}=Zc\+γc←rCA\(Zc,Zr\),\\displaystyle=Z\_\{c\}\+\\gamma\_\{c\\leftarrow r\}\\,\\mathrm\{CA\}\(Z\_\{c\},Z\_\{r\}\),\(2\)Z~r\\displaystyle\\tilde\{Z\}\_\{r\}=Zr\+γr←cCA\(Zr,Zc\),\\displaystyle=Z\_\{r\}\+\\gamma\_\{r\\leftarrow c\}\\,\\mathrm\{CA\}\(Z\_\{r\},Z\_\{c\}\),whose LayerScale coefficientsγ\\gammaare initialized near zero, so fusion is identity\-preserving at initialization and warm\-starts stably\. The fused contextM=\[Z~c,Z~r\]M=\[\\tilde\{Z\}\_\{c\},\\tilde\{Z\}\_\{r\}\]is cross\-attended by the trajectory decoder to produce𝒯\\mathcal\{T\}, letting global risk structure steer the budget toward feasible behaviors while suppressing unsafe or off\-route proposals\. The sameMMis shared with the selection scorer described next, so risk shapes both candidate representation and final ranking\.
### Risk\-Aware Best\-Candidate Selection
Even a strong scorer mis\-ranks geometrically similar good candidates when risk stays implicit, so this module hands the scorer a trajectory\-conditioned readout of the RiskOcc field to expose the fine progress–risk margin that separates them\. For each candidate, scorer attention reads the shared context,ui=Attn\(qi,M\)u\_\{i\}=\\mathrm\{Attn\}\(q\_\{i\},M\)\. Because global tokens alone cannot reveal which risk regions a proposal traverses, we add a trajectory\-conditioned local query\. At waypointtt, the ego footprintℬ\(τi,t\)\\mathcal\{B\}\(\\tau\_\{i,t\}\)is placed on the BEV grid and bilinearly samples the time\-aligned mapR¯t=\[Rs,Rα\(t\)d,Rl\]\\bar\{R\}\_\{t\}=\[R^\{s\},R^\{d\}\_\{\\alpha\(t\)\},R^\{l\}\], whereα\(t\)\\alpha\(t\)aligns waypointttto dynamic framett\(clamped toTr−1T\_\{r\}\{\-\}1\)\. For channelcc, exposure is a top\-kkmean over footprint points,
𝒫i,t,c\\displaystyle\\mathcal\{P\}\_\{i,t,c\}=TopKk\{R¯t,c\(q\):q∈ℬ\(τi,t\)\},\\displaystyle=\\mathrm\{TopK\}\_\{k\}\\\{\\bar\{R\}\_\{t,c\}\(q\):q\\in\\mathcal\{B\}\(\\tau\_\{i,t\}\)\\\},\(3\)ρi,t,c\\displaystyle\\rho\_\{i,t,c\}=1k∑p∈𝒫i,t,cR¯t,c\(p\),\\displaystyle=\\tfrac\{1\}\{k\}\\sum\\nolimits\_\{p\\in\\mathcal\{P\}\_\{i,t,c\}\}\\bar\{R\}\_\{t,c\}\(p\),which retains local peaks that plain averaging would dilute\. The per\-waypoint sequence is summarized into a fixed descriptor
gi=Concat\(CLOSE\\displaystyle g\_\{i\}=\\mathrm\{Concat\}\\big\(OPENmeantρi,t,maxtρi,t,mintρi,t,ρi,Tp\),\\displaystyle\\operatorname\{mean\}\_\{t\}\\rho\_\{i,t\},\\ \\max\_\{t\}\\rho\_\{i,t\},\\ \\min\_\{t\}\\rho\_\{i,t\},\\ \\rho\_\{i,T\_\{p\}\}\\big\),\(4\)capturing average exposure, closest\-approach risk, low\-risk feasibility, and terminal risk\. For each submetricm∈\{NC,DAC,DDC,TTC,EP,C\}m\\in\\\{\\mathrm\{NC\},\\mathrm\{DAC\},\\mathrm\{DDC\},\\mathrm\{TTC\},\\mathrm\{EP\},\\mathrm\{C\}\\\}, the descriptor augments only the risk\-aware headsℳrisk\\mathcal\{M\}\_\{\\mathrm\{risk\}\}, while the rest useuiu\_\{i\}alone,
him=\{fm\(\[ui,gi\]\),m∈ℳrisk,fm\(ui\),otherwise\.h\_\{i\}^\{m\}=\\begin\{cases\}f\_\{m\}\(\[u\_\{i\},g\_\{i\}\]\),&m\\in\\mathcal\{M\}\_\{\\mathrm\{risk\}\},\\\\ f\_\{m\}\(u\_\{i\}\),&\\text\{otherwise\}\.\\end\{cases\}\(5\)Letℳp=\{NC,DAC,DDC\},ℳw=\{TTC,EP,C\}\\mathcal\{M\}\_\{\\mathrm\{p\}\}=\\\{\\textnormal\{NC\},\\\!\\textnormal\{DAC\},\\\!\\textnormal\{DDC\}\\\},\\quad\\mathcal\{M\}\_\{\\mathrm\{w\}\}=\\\{\\textnormal\{TTC\},\\\!\\textnormal\{EP\},\\\!\\textnormal\{C\}\\\}\. Selection keeps the PDM\-style weighted\-log aggregation,
si\\displaystyle s\_\{i\}=∑m∈ℳpwmlogpim\+log\(∑m∈ℳwwmpim\),\\displaystyle=\\sum\_\{m\\in\\mathcal\{M\}\_\{\\mathrm\{p\}\}\}w\_\{m\}\\log p\_\{i\}^\{m\}\+\\log\\\!\\Big\(\\sum\_\{m\\in\\mathcal\{M\}\_\{\\mathrm\{w\}\}\}w\_\{m\}\\,p\_\{i\}^\{m\}\\Big\),\(6\)i⋆\\displaystyle i^\{\\star\}=argmaxisi\.\\displaystyle=\\arg\\max\\nolimits\_\{i\}s\_\{i\}\.This preserves the baseline’s multi\-submetric structure and avoids a manual risk penalty\. Since simple statistics such as risk mean or max correlate only weakly with true PDMS and safety submetrics, RiskOcc acts not as a linear surrogate but as trajectory\-aligned nonlinear evidence for the neural scorer\. Figure[4](https://arxiv.org/html/2609.21486#Sx3.F4)depicts this ranking module\.
Figure 4:Risk\-aware candidate ranking module\. For each candidate, the ego footprint samples the time\-aligned risk field along the trajectory to form a local risk profile, which augments the risk\-sensitive scorer heads and sharpens ranking among geometrically similar good candidates\.For the refinement phase, the proposal generator and trajectory decoder are frozen, and only the risk encoder, scorer attention, and the TTC/EP heads are updated\. The objective keeps the submetric BCE terms and adds continuous smooth\-ℓ1\\ell\_\{1\}calibration \(SL1\\mathrm\{SL\}\_\{1\}\) for the two risk\-sensitive submetrics,
ℒ\\displaystyle\\mathcal\{L\}=∑mλmℒBCE\(pm,ym\)\+λTTCSL1\(pTTC,ycTTC\)\\displaystyle=\\sum\_\{m\}\\lambda\_\{m\}\\mathcal\{L\}\_\{\\mathrm\{BCE\}\}\(p^\{m\},y^\{m\}\)\+\\lambda\_\{\\mathrm\{TTC\}\}\\,\\mathrm\{SL\}\_\{1\}\(p^\{\\mathrm\{TTC\}\},y^\{\\mathrm\{TTC\}\}\_\{\\mathrm\{c\}\}\)\(7\)\+λEPSL1\(pEP,ycEP\)\.\\displaystyle\+\\lambda\_\{\\mathrm\{EP\}\}\\,\\mathrm\{SL\}\_\{1\}\(p^\{\\mathrm\{EP\}\},y^\{\\mathrm\{EP\}\}\_\{\\mathrm\{c\}\}\)\.Although the non\-target heads are frozen, their BCE losses still backpropagate through the shared scorer features, anchoring NC, DAC, DDC, and comfort during refinement\. The model thus does not relearn the planner but sharpens its interpretation of the RiskOcc–trajectory relation, concentrating gains in fine\-grained ranking among high\-quality candidates—particularly TTC\-sensitive exposure and progress\-aware selection once safety is satisfied—rather than inducing conservative behavior\.
### Risk\-Aware Occupancy Generation
Both pathways above learn from a ground\-truth RiskOcc field, so this module constructs that supervision itself as the RiskOcc\-NAVSIM labels\. We distill dense risk\-aware occupancy representation from NAVSIM on a shared ego\-centric BEV lattice ofH×W=400×400H\\times W=400\\times 400grid cells at resolutionΔ=0\.25m\\Delta=0\.25\\,\\mathrm\{m\}\(covering\[−50,50\)2m\[\-50,50\)^\{2\}\\,\\mathrm\{m\}\), with risk normalized tor∈\[0,1\]r\\in\[0,1\]\. An ego\-frame point\(x,y\)\(x,y\)maps to the grid cell\(i,j\)=\(⌊\(y−ymin\)/Δ⌋,⌊\(x−xmin\)/Δ⌋\)\(i,j\)=\(\\lfloor\(y\{\-\}y\_\{\\min\}\)/\\Delta\\rfloor,\\ \\lfloor\(x\{\-\}x\_\{\\min\}\)/\\Delta\\rfloor\)withxmin=ymin=−50x\_\{\\min\}\{=\}y\_\{\\min\}\{=\}\{\-\}50and metric grid cell centerpijp\_\{ij\}\. Three pipelines yield complementary targets: a map\-derived*lane\-marking RiskOcc map*, a point\-cloud*global RiskOcc map*refined by that prior, and an annotation\-derived*dynamic RiskOcc map*; the last two are stacked into the final label\.
#### Map\-Derived Risk\-Aware Occupancy
From the vectorized HD map, we rasterize a single\-channel priorM∈ℝH×WM\\in\\mathbb\{R\}^\{H\\times W\}, where each grid cell inherits the value of the top\-most \(highest\-priority\) layer covering it:
M\(i,j\)=ϕ\(ℓ⋆\),ℓ⋆=argmaxℓ∈ℒπ\(ℓ\)1\[pij∈ℓ\],M\(i,j\)=\\phi\(\\ell^\{\\star\}\),\\quad\\ell^\{\\star\}=\\arg\\max\_\{\\ell\\in\\mathcal\{L\}\}\\pi\(\\ell\)\\,\\mathbb\{1\}\[p\_\{ij\}\\in\\ell\],\(8\)
with render priorityπ\(⋅\)\\pi\(\\cdot\)and coverage indicator𝟙\[⋅\]\\mathbb\{1\}\[\\cdot\]\. The layer valuesϕ\\phiare drivable interior00, background0\.050\.05, crosswalk/stop\-line/lane boundary0\.10\.1, drivable boundary0\.20\.2, walkway0\.30\.3, and lane\-connector centerline−0\.1\-0\.1\.MMis reused in the global map pipeline\.
#### Global Risk\-Aware Occupancy
The semantic point cloud is voxelized into a400×400×16400\\times 400\\times 16grid \(z∈\[−2,2\)z\\in\[\-2,2\)\); a voxel is occupied if it holds more than two points, taking the majority semantic labelVV, else background\. For each BEV grid cell, we scan its column upward from the ground \(z=0z\{=\}0\) for the first salient voxelw⋆w^\{\\star\}\(neither road nor background\) at height indexη\\eta\(largerη\\eta= taller\)\. With normalized heighth^=Δη/2\.5\\hat\{h\}=\\Delta\\eta/2\.5andg=clip\(0\.8h^\+0\.2,0,1\)g=\\operatorname\{clip\}\(0\.8\\hat\{h\}\+0\.2,0,1\), the point\-cloud risk isRpc=1R\_\{\\mathrm\{pc\}\}=1ifV\(w⋆\)=2V\(w^\{\\star\}\)=2,Rpc=gR\_\{\\mathrm\{pc\}\}=gifV\(w⋆\)∈\{1,3\}V\(w^\{\\star\}\)\\in\\\{1,3\\\}, and00otherwise\. We fuse with the lane prior by element\-wise maximum \(∨\\vee\) and refine with one grayscale morphological closing \(3×33\\times 3elementBB\),R=\(\(Rpc∨M\)⊕B\)⊖BR=\(\(R\_\{\\mathrm\{pc\}\}\\vee M\)\\oplus B\)\\ominus B\. Finally,RRis quantized into1111ordinal classes: class00forR<0\.05R<0\.05, class1010for free background \(R=0\.05R\{=\}0\.05\), and classes11–99for monotonically increasing risk over\(0\.05,1\]\(0\.05,1\]\.
#### Dynamic Risk\-Aware Occupancy
We produce a spatio\-temporal tensor ofT=12T=12frames \(indexk∈\{0,…,11\}k\\in\\\{0,\\dots,11\\\}atδt=0\.5s\\delta t=0\.5\\,\\mathrm\{s\}, i\.e\.t=kδt∈\{0,…,5\.5\}st=k\\,\\delta t\\in\\\{0,\\dots,5\.5\\\}\\,\\mathrm\{s\}\), all expressed in thet=0t\{=\}0ego frame\. Only agents of\{\\\{vehicles, pedestrians, and bicycles\}\\\}visiblet=0t\{=\}0are kept, with short gaps \(≤2\\leq 2consecutive missing frames\) linearly interpolated\. Each agent carries a velocity clamped and normalized into thet=0t\{=\}0frame,v~=clip\(v/20,−1,1\)\\tilde\{v\}=\\operatorname\{clip\}\(v/20,\-1,1\),s=∥v~∥2s=\\lVert\\tilde\{v\}\\rVert\_\{2\}, and a frame\-indexed risk that decays over the horizon and grows with speed:
ρak=min\(\(1−0\.05k\)\+0\.05s/2,1\)\.\\rho\_\{a\}^\{\\,k\}=\\min\\\!\\Big\(\(1\-0\.05\\,k\)\+0\.05\\,s/\\sqrt\{2\},\\ 1\\Big\)\.\(9\)An agent with centercakc\_\{a\}^\{k\}, size\(ℓa,wa\)\(\\ell\_\{a\},w\_\{a\}\)and heading unit vector𝐮θ\\mathbf\{u\}\_\{\\theta\}occupies the grid cell\(i,j\)\(i,j\)when the grid cell centerpijp\_\{ij\}lies inside its oriented box\. Overlaps are resolved by priority, keeping the higher\-risk agent and breaking ties by the smaller instance identity,a⋆=argmaxa:Bak\(i,j\)=1\(ρak,−ida\)a^\{\\star\}=\\arg\\max\_\{a:\\,B\_\{a\}^\{\\,k\}\(i,j\)=1\}\(\\rho\_\{a\}^\{\\,k\},\\,\-\\mathrm\{id\}\_\{a\}\)—so each occupied grid cell stores the winning agent’s riskρa⋆k\\rho\_\{a^\{\\star\}\}^\{\\,k\}and velocity\(v~x,v~y\)\(\\tilde\{v\}\_\{x\},\\tilde\{v\}\_\{y\}\), while free grid cells are zero\.
### External RiskOcc Predictor
#### Formulation
Injecting a temporal, BEV\-based occupancy branch inside our planner would break its lightweight, history\-free, PV register\-token design, so we keep risk perception external as a standalone predictor that serves only as a probe of the planner’s robustness to lossy predicted RiskOcc\. Given a short sensor observation𝒪\\mathcal\{O\}, this predictorfθf\_\{\\theta\}emits a BEV RiskOcc field of a static map, a lane map, and a dynamic general\-movable\-object \(GMO\) sequence with per\-cell motion,
fθ\(𝒪\)=\(CLOSE\\displaystyle f\_\{\\theta\}\(\\mathcal\{O\}\)=\\big\(𝐑s,𝐑ℓ∈\[0,1\]H×W,\\displaystyle\\mathbf\{R\}^\{s\},\\,\\mathbf\{R\}^\{\\ell\}\\in\[0,1\]^\{H\\times W\},\(10\)OPEN𝐑d∈\[0,1\]T×H×W,𝐕∈ℝT×H×W×2\),\\displaystyle\\mathbf\{R\}^\{d\}\\in\[0,1\]^\{T\\times H\\times W\},\\;\\mathbf\{V\}\\in\\mathbb\{R\}^\{T\\times H\\times W\\times 2\}\\,\\big\),withH=W=400H=W=400,T=12T=12, through a two\-stage encoder–decoder𝒪→Φ𝐁→Ψ\(⋅\)\\mathcal\{O\}\\xrightarrow\{\\Phi\}\\mathbf\{B\}\\xrightarrow\{\\Psi\}\(\\cdot\)with fused BEV𝐁∈ℝ256×50×50\\mathbf\{B\}\\in\\mathbb\{R\}^\{256\\times 50\\times 50\}, and⊙\\odotdenotes the Hadamard product\.
#### Architecture
The encoderΦ\\Phioutputs a BEV feature𝐁\\mathbf\{B\}by fusing two streams: an ego\-aligned motion history summarized by a selective state\-space operator, and a multi\-height deformable camera\-to\-BEV lift following FusionAD\([Ye et al\. 2023](https://arxiv.org/html/2609.21486#bib.bib31)\)\. The streams are merged by residual spatial cross\-attention, with modality dropout for robustness to missing sensors\. The decoderΨ\\Psiupsamples𝐁\\mathbf\{B\}with skip fusion and predicts static and lane risk through class\-first heads \(a class map that conditions a risk regressor\)\.
The dynamic branch operates on a stop\-gradient BEV context𝐏\\mathbf\{P\}\. For each future framett, a per\-frame query𝐪t\\mathbf\{q\}\_\{t\}drives a deformable forecaster𝐅t=𝒟\(𝐪t,𝐏\)\\mathbf\{F\}\_\{t\}=\\mathcal\{D\}\(\\mathbf\{q\}\_\{t\},\\mathbf\{P\}\); a FiLM module conditioned on an occupancy prior \(AdaNorm\) refines it into𝐅~t\\tilde\{\\mathbf\{F\}\}\_\{t\}through a LayerScale residual, and a denseK=12K\\\!=\\\!12head maps𝐅~t\\tilde\{\\mathbf\{F\}\}\_\{t\}to per\-level logits𝐳td\\mathbf\{z\}^\{d\}\_\{t\}\. The exported dynamic risk is the softmax\-class expectation over the discrete levels\{rc\}c=1K\\\{r\_\{c\}\\\}\_\{c=1\}^\{K\},
𝐑td=∑c=1Ksoftmax\(𝐳td\)crc,\\mathbf\{R\}^\{d\}\_\{t\}=\\sum\\nolimits\_\{c=1\}^\{K\}\\operatorname\{softmax\}\(\\mathbf\{z\}^\{d\}\_\{t\}\)\_\{c\}\\,r\_\{c\},\(11\)and the velocity field is gated by the same expectation,𝐕t=𝐑td⊙Vel\(𝐅~t\)\\mathbf\{V\}\_\{t\}=\\mathbf\{R\}^\{d\}\_\{t\}\\odot\\operatorname\{Vel\}\(\\tilde\{\\mathbf\{F\}\}\_\{t\}\)withVel\\operatorname\{Vel\}a linear readout\. This continuous expectation, rather than a hard threshold, preserves near\-frame accuracy, while a clean\-label ground truth retaining onlyt=0t\\\!=\\\!0\-visible targets suppresses spurious far\-frame occupancy\.
## Experiments
RRDrive closes the two bottlenecks raised in the abstract—the low\-quality floor of the candidate set and the unreliable fine\-grained ranking of near\-identical good candidates—most decisively where the baseline is weakest\. Each claim has a dedicated experiment: candidate generation \(Table[3](https://arxiv.org/html/2609.21486#Sx4.T3)\), scene\-level ranking \(Tables[4](https://arxiv.org/html/2609.21486#Sx4.T4)and[5](https://arxiv.org/html/2609.21486#Sx4.T5)\), the concentration of both gains in the hardest scenes \(Table[6](https://arxiv.org/html/2609.21486#Sx4.T6)\), per\-component attribution \(Table[2](https://arxiv.org/html/2609.21486#Sx4.T2)\), and benchmark standing \(Table[1](https://arxiv.org/html/2609.21486#Sx4.T1)\)\.
Table 1:Comparison of results on the NAVSIM benchmark\. All metrics are higher\-is\-better\. Best results are highlighted in bold\. VLA\-based and E2E methods are sorted ascendingly by PDMS\.↑\\uparrow/↓\\downarrow: higher / lower is better\.### Experimental Setup
We evaluate on NAVSIM*navtest*\(12,14612\{,\}146scenes,6464candidates each\), reporting PDMS and its submetrics \(NC, DAC, DDC, TTC, EP, C\)\. Candidates are graded by the oracle PDMSqqas*bad*\(q<0\.3q\\\!<\\\!0\.3\),*poor*\(≤q<0\.70\.3\\\!\\leq\\\!q\\\!<\\\!0\.7\), or*good*\(q≥0\.7q\\\!\\geq\\\!0\.7\); all methods take the scorer argmax without re\-ranking, and the baseline is a faithfully reproduced DrivoR under the same protocol\. The external RiskOcc predictor is trained offline by
ℒ=ℒs\+12ℒℓ\+32ℒd\+15ℒv\+310ℒcam,\\mathcal\{L\}=\\mathcal\{L\}\_\{s\}\+\\tfrac\{1\}\{2\}\\mathcal\{L\}\_\{\\ell\}\+\\tfrac\{3\}\{2\}\\mathcal\{L\}\_\{d\}\+\\tfrac\{1\}\{5\}\\mathcal\{L\}\_\{v\}\+\\tfrac\{3\}\{10\}\\mathcal\{L\}\_\{\\mathrm\{cam\}\},\(12\)with static/lane heads using focal\-CE, Dice, and smooth\-ℓ1\\ell\_\{1\}/SSIM, and a dense dynamicℒd\\mathcal\{L\}\_\{d\}combining CE, Dice, Lovász, a weighted foreground BCE for recall, a false\-positive\-penalizing Tversky \(0\.3FN\+0\.7FP0\.3\\,\\mathrm\{FN\}\{\+\}0\.7\\,\\mathrm\{FP\}\), and an AdaNorm auxiliary\.
### Main Results
Table[1](https://arxiv.org/html/2609.21486#Sx4.T1)reports PDMS and its submetrics against recent VLA\-based and end\-to\-end planners on NAVSIM*navtest*\. Placing our register\-based planner at the top of the end\-to\-end group confirms that closing the candidate\-quality and ranking gaps identified in the abstract yields a state\-of\-the\-art final score, with the margin driven by the ego\-progress \(EP\) and time\-to\-collision \(TTC\) terms while the safety submetrics stay saturated\.
### Gain on Candidate Generation Quality
Table[3](https://arxiv.org/html/2609.21486#Sx4.T3)evaluates the candidate pool—good/bad ratios, mean candidate PDMS, and good candidates per scene—independently of the scorer, isolating the abstract’s first bottleneck \(a low candidate\-quality floor\) and the risk\-conditioned generation module built to raise it\. On these metrics RiskOcc raises the*good ratio*\(fraction of candidates withq≥0\.7q\\\!\\geq\\\!0\.7\) by8\.48\.4percentage points, nearly halves the*bad ratio*\(q<0\.3q\\\!<\\\!0\.3\), improves the*mean candidate PDMS*from0\.7970\.797to0\.8580\.858, and increases the number of*good candidates per scene*from51\.451\.4to56\.856\.8\.
Figure 5:Qualitative comparison of candidate generation on two generation\-challenging scenes\. Compared with DrivoR \(third column\), RRDrive \(fourth column\) concentrates the finite proposal budget within feasible, high\-quality regions aligned with the expert trajectory, producing more good candidates and higher mean candidate PDMS\.Table 2:Cumulative ablation on navtest \(argmax, no re\-ranking\), decomposed into all PDMS sub\-metrics\.Moduletags the*primary*pathway each component serves: Gen\. = candidate generation, Rank\. = candidate ranking\. All metrics are higher\-is\-better; NC = no at\-fault collision, DAC = drivable\-area compliance, DDC = driving\-direction compliance, TTC = time\-to\-collision, EP = ego\-progress, Comf\. = comfort\.Δ\\Deltais the absolute PDMS gain over the preceding row\. Rows are model\-lineage proxies: each step carries minor co\-changes, so tags denote the dominant pathway rather than an exclusive one\.This reflects a*concentration*rather than a diversification of the candidate budget: among good candidates, the endpoint spread shrinks from2\.812\.81to1\.551\.55m and the number of distinct endpoint modes drops from20\.720\.7to16\.216\.2, i\.e\. RiskOcc reallocates proposals from infeasible behaviors toward the feasible high\-quality region\. The qualitative comparison in Figure[5](https://arxiv.org/html/2609.21486#Sx4.F5)confirms that RRDrive overcomes the low\-quality candidate\-generation failure by concentrating the finite proposal budget within feasible, high\-quality motion regions rather than dispersing it across unsafe or ineffective branches\. In the two generation\-challenging scenes, the fourth column produces compact candidate bundles aligned with the expert trajectory, yielding43/6443/64and54/6454/64good candidates with mean PDMS values of0\.7690\.769and0\.8080\.808, whereas the DrivoR candidates in the third column diverge toward multiple low\-score branches and contain only26/6426/64and8/648/64good candidates with mean PDMS values of0\.4890\.489and0\.2440\.244, respectively\.
Table 3:Candidate generation quality\.↑\\uparrow/↓\\downarrow: higher / lower is better;Δ\(%\)\\Delta\(\\%\)is the relative change over the baseline\.
### Gain on Candidate Ranking
Table[4](https://arxiv.org/html/2609.21486#Sx4.T4)assesses how the scorer orders the6464candidates within each scene—scene\-wise Spearman between predicted and true PDMS, oracle recall@KK\(whether the true optimum lies in the topKK\), oracle rank of the true optimum \(lower is better\), oracle gap \(PDMS shortfall of the selected trajectory relative to the in\-scene optimum\), and the selected PDMS—directly targeting the abstract’s second bottleneck, unreliable fine\-grained ranking, which the trajectory\-conditioned local risk pathway is built to fix\. RiskOcc improves every metric: the scene\-wise Spearman correlation rises from0\.4070\.407to0\.5840\.584, oracle recall@1 from5\.1%5\.1\\%to15\.4%15\.4\\%\(3\.0×3\.0\\times\), the oracle rank from33\.933\.9to27\.727\.7, and the selected PDMS from0\.9370\.937to0\.9510\.951\. To probe the underlying mechanism, Table[5](https://arxiv.org/html/2609.21486#Sx4.T5)predicts the good\-candidate order from geometry, risk, or both under scene\-grouped cross\-validation: the risk profile contributes substantial ranking information beyond geometry \(→0\.530\.37\\\!\\to\\\!0\.53\), whereas risk alone is weak\. This is consistent with the weak linear correlation between simple risk statistics and PDMS \(\|r\|<0\.08\|r\|\\\!<\\\!0\.08\) and the comparable global scorer\-PDMS Pearson of the two models \(0\.570\.57vs\.0\.560\.56\): RiskOcc functions as nonlinear evidence for the scorer rather than a linear surrogate\.
Table 4:Scene\-level ranking quality\.↑\\uparrow/↓\\downarrow: higher / lower is better;Δ\(%\)\\Delta\(\\%\)is the relative improvement over the baseline\.Figure 6:Qualitative comparison of candidate ranking\. Within dense bundles of geometrically similar, high\-quality candidates, RRDrive selects a near\-optimal trajectory where the baseline \(third column\) mis\-ranks and selects a low\-scoring one, isolating the improvement to ranking rather than to candidate generation\.Table 5:Within\-good\-candidate ranking under scene\-grouped cross\-validation \(mean scene\-wise Spearman↑\\uparrow\): the risk profile adds ranking information beyond trajectory geometry\.The qualitative comparison in Figure[6](https://arxiv.org/html/2609.21486#Sx4.F6)confirms that RRDrive resolves the fine\-grained ranking failure by identifying the best trajectory within dense bundles of geometrically similar, high\-quality candidates\. In the upper scene, the baseline method in the third column already generates58/6458/64good candidates with a mean PDMS of0\.9260\.926and contains an oracle trajectory with PDMS1\.0001\.000, yet selects a trajectory scoring only0\.5660\.566, while RRDrive selects a0\.9760\.976trajectory; more decisively, in the lower scene, DrivoR has slightly better pool statistics than RRDrive \(55/6455/64good candidates and mean PDMS0\.9280\.928versus53/6453/64and0\.9130\.913\) but selects a0\.4850\.485trajectory, whereas RRDrive selects the1\.0001\.000trajectory, isolating the improvement to candidate ranking rather than candidate generation\.
### Difficulty\-Stratified Analysis
Table[6](https://arxiv.org/html/2609.21486#Sx4.T6)partitions the scenes into terciles by baseline difficulty and reports, for the hardest tercile of each axis, candidate PDMS and good ratio \(generation\), scene Spearman and selected PDMS \(ranking\), and in\-good Spearman and oracle recall@1 \(confusion\), testing the abstract’s claim that the gains land where the baseline is weakest\. They do, concentrating in the hardest cases along both axes\. In the hardest*generation*tercile \(lowest baseline candidate PDMS\), pool quality improves most; in the hardest*ranking*tercile \(largest baseline oracle gap\) and the hardest*confusion*tercile \(good candidates most similar in quality\), the ranking metrics improve most, with the within\-good Spearman rising from0\.2650\.265to0\.6740\.674and oracle recall@1 from3\.6%3\.6\\%to24\.9%24\.9\\%\.
Table 6:Hardest\-tercile analysis \(baseline vs\. Ours\)\. All listed metrics are higher\-is\-better \(↑\\uparrow\);Δ\(%\)\\Delta\(\\%\)is the relative improvement over the baseline\.
### Ablation Study
Table[2](https://arxiv.org/html/2609.21486#Sx4.T2)decomposes each RiskOcc component under a strict argmax protocol \(no re\-ranking\), reporting the full PDMS sub\-metric breakdown\. Starting from the reproduced DrivoR baseline \(PDMS0\.93670\.9367\), we add components cumulatively and tag each by its primary pathway—generation \(Gen\.\) or ranking \(Rank\.\)\.
Generation vs\. ranking contributions\.The two generation\-oriented components—global risk encoding and bidirectional cross\-modal fusion—raise the score by\+0\.0104\+0\.0104, while the two ranking\-oriented components—trajectory\-conditioned risk sampling and the TTC/EP & risk\-representation refinement—add a further\+0\.0035\+0\.0035, reaching0\.9506\\mathbf\{0\.9506\}for a total gain of\+0\.0139\+0\.0139\. Consistent with our two design goals, conditioning generation on the global RiskOcc field yields the larger share by improving the candidate pool, whereas the trajectory\-aligned risk profile contributes a smaller but complementary gain by sharpening selection among already\-strong candidates\.
Where the gain comes from\.The improvement concentrates in ego\-progress \(EP→0\.92190\.8991\\\!\\rightarrow\\\!0\.9219,\+0\.0228\+0\.0228\) and time\-to\-collision \(TTC→0\.97550\.9672\\\!\\rightarrow\\\!0\.9755\), while the safety\-critical sub\-metrics remain saturated throughout \(NC≥0\.992\\geq 0\.992, DAC≥0\.989\\geq 0\.989, DDC≥0\.972\\geq 0\.972, Comfort=1\.000=1\.000\)\. The gain therefore stems from more accurate progress\- and TTC\-aware generation and selection rather than from conservative, progress\-sacrificing behavior—precisely the fine progress–risk trade\-off that an explicit, trajectory\-aligned risk signal is designed to resolve\.
### Robustness to Lossy RiskOcc
To test whether the framework depends on oracle risk, we train an external RiskOcc prediction module that infers the risk modality from sensors, yielding a lossy RiskOcc field in place of the ground truth\. As the scorer is trained on clean risk, we bridge the train/test discrepancy via a lightweight mixed\-source adaptation over ground\-truth and predicted RiskOcc\. With fully predicted risk, RRDrive attains a PDMS of0\.94000\.9400, clearly exceeding the no\-RiskOcc baseline \(0\.93670\.9367\) while trailing the oracle\-risk upper bound \(0\.95060\.9506\)\. The residual gap stems mainly from our perception module, whose multi\-step temporal forecasting of RiskOcc remains limited; improving this prediction quality—where substantial headroom remains—would directly benefit the fusion framework\. These gains under lossy, sensor\-derived risk confirm that they arise from the risk\-aware formulation rather than from privileged access to oracle risk\.
## Conclusion
We identify compact scene representation as a shared bottleneck of multimodal trajectory generation and selection, and address it with risk\-aware occupancy \(RiskOcc\), a dense, temporally aligned, trajectory\-queryable field that unifies static, lane, and dynamic risks\. Built on this representation, RRDrive conditions candidate generation on the global risk field and augments the scorer with a trajectory\-aligned local risk profile, while RiskOcc\-NAVSIM supplies the required supervision through automatic annotation\. RRDrive raises candidate quality and ranking reliability, especially in the hardest scenes, and attains a state\-of\-the\-art PDMS of 0\.951\. An external predictor further verifies that such performance gains persist under sensor\-derived risk\. The main remaining limitation lies in the multi\-step temporal forecasting of dynamic RiskOcc, and improving its prediction quality is a promising direction to fully unlock the representation’s benefits for end\-to\-end driving\.
## References
- Buet al\.\(2025\)Q\. Bu, Y\. Yang, J\. Cai, S\. Gao, G\. Ren, M\. Yao, P\. Luo, and H\. LiUniVLA: learning to act anywhere with task\-centric latent actions\.External Links:2505\.06111,[Link](https://arxiv.org/abs/2505.06111)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.7.1)\.
- Chenet al\.\(2024a\)J\. Chen, W\. Zhong, B\. Gao, Y\. Liu, H\. Zou, J\. Liu, Y\. Lu, J\. Huang, and Z\. ZhongRisk occupancy: a new and efficient paradigm through vehicle\-road\-cloud collaboration\.External Links:2408\.07367,[Link](https://arxiv.org/abs/2408.07367)Cited by:[Introduction](https://arxiv.org/html/2609.21486#Sx1.p3.1)\.
- Chenet al\.\(2024b\)Y\. Chen, Y\. Wang, and Z\. ZhangDrivingGPT: unifying driving world modeling and planning with multi\-modal autoregressive transformers\.External Links:2412\.18607,[Link](https://arxiv.org/abs/2412.18607)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.16.1)\.
- Chittaet al\.\(2022\)K\. Chitta, A\. Prakash, B\. Jaeger, Z\. Yu, K\. Renz, and A\. GeigerTransFuser: imitation with transformer\-based sensor fusion for autonomous driving\.External Links:2205\.15997,[Link](https://arxiv.org/abs/2205.15997)Cited by:[Related Work](https://arxiv.org/html/2609.21486#Sx2.p1.1)\.
- Dauneret al\.\(2023\)D\. Dauner, M\. Hallgarten, A\. Geiger, and K\. ChittaParting with misconceptions about learning\-based vehicle motion planning\.External Links:2306\.07962,[Link](https://arxiv.org/abs/2306.07962)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.4.1)\.
- Dauneret al\.\(2024\)D\. Dauner, M\. Hallgarten, T\. Li, X\. Weng, Z\. Huang, Z\. Yang, H\. Li, I\. Gilitschenski, B\. Ivanovic, M\. Pavone, A\. Geiger, and K\. ChittaNAVSIM: data\-driven non\-reactive autonomous vehicle simulation and benchmarking\.External Links:2406\.15349,[Link](https://arxiv.org/abs/2406.15349)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.3.1.1),[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.5.1)\.
- Fenget al\.\(2026\)L\. Feng, Y\. Gao, E\. Zablocki, Q\. Li, W\. Li, S\. Liu, M\. Cord, and A\. AlahiRAP: 3d rasterization augmented end\-to\-end planning\.External Links:2510\.04333,[Link](https://arxiv.org/abs/2510.04333)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.31.1)\.
- Guiet al\.\(2025\)X\. Gui, J\. Zhao, W\. Han, J\. Wang, J\. Gong, F\. Tan, C\. Xu, and J\. ShenTrajDiff: end\-to\-end autonomous driving without perception annotation\.External Links:2512\.00723,[Link](https://arxiv.org/abs/2512.00723)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.25.1)\.
- Guoet al\.\(2025\)K\. Guo, H\. Liu, X\. Wu, J\. Pan, and C\. LvIPad: iterative proposal\-centric end\-to\-end autonomous driving\.External Links:2505\.15111,[Link](https://arxiv.org/abs/2505.15111)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.27.1)\.
- Huet al\.\(2023\)Y\. Hu, J\. Yang, L\. Chen, K\. Li, C\. Sima, X\. Zhu, S\. Chai, S\. Du, T\. Lin, W\. Wang, L\. Lu, X\. Jia, Q\. Liu, J\. Dai, Y\. Qiao, and H\. LiPlanning\-oriented autonomous driving\.External Links:2212\.10156,[Link](https://arxiv.org/abs/2212.10156)Cited by:[Related Work](https://arxiv.org/html/2609.21486#Sx2.p1.1),[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.17.1)\.
- Jianget al\.\(2026\)B\. Jiang, S\. Chen, H\. Gao, B\. Liao, Q\. Zhang, W\. Liu, and X\. WangVADv2: end\-to\-end vectorized autonomous driving via probabilistic planning\.External Links:2402\.13243,[Link](https://arxiv.org/abs/2402.13243)Cited by:[Related Work](https://arxiv.org/html/2609.21486#Sx2.p2.1),[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.21.1)\.
- Kirbyet al\.\(2026\)E\. Kirby, A\. Boulch, Y\. Xu, Y\. Yin, G\. Puy, É\. Zablocki, A\. Bursuc, S\. Gidaris, R\. Marlet, F\. Bartoccioni, A\. Cao, N\. Samet, T\. VU, and M\. CordDriving on registers\.External Links:2601\.05083,[Link](https://arxiv.org/abs/2601.05083)Cited by:[Introduction](https://arxiv.org/html/2609.21486#Sx1.p2.1),[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.30.1)\.
- Liet al\.\(2026a\)J\. Li, J\. Wu, D\. Hu, X\. Huang, B\. Sun, Z\. Hao, X\. Lang, X\. Zhu, and L\. ZhangSGDrive: scene\-to\-goal hierarchical world cognition for autonomous driving\.External Links:2601\.05640,[Link](https://arxiv.org/abs/2601.05640)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.13.1)\.
- Liet al\.\(2025a\)K\. Li, Z\. Li, S\. Lan, Y\. Xie, Z\. Zhang, J\. Liu, Z\. Wu, Z\. Yu, and J\. M\. AlvarezHydra\-mdp\+\+: advancing end\-to\-end driving via expert\-guided hydra\-distillation\.External Links:2503\.12820,[Link](https://arxiv.org/abs/2503.12820)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.26.1)\.
- Liet al\.\(2026b\)P\. Li, J\. Wang, H\. Zhang, X\. Shi, N\. Koshizuka, C\. Shimizu, and R\. JiangTrajFlow: nation\-wide pseudo gps trajectory generation with flow matching models\.External Links:2603\.15009,[Link](https://arxiv.org/abs/2603.15009)Cited by:[Related Work](https://arxiv.org/html/2609.21486#Sx2.p3.1)\.
- Liet al\.\(2025b\)Y\. Li, S\. Shang, W\. Liu, B\. Zhan, H\. Wang, Y\. Wang, Y\. Chen, X\. Wang, Y\. An, C\. Tang, L\. Hou, L\. Fan, and Z\. ZhangDriveVLA\-w0: world models amplify data scaling law in autonomous driving\.External Links:2510\.12796,[Link](https://arxiv.org/abs/2510.12796)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.10.1)\.
- Liet al\.\(2025c\)Y\. Li, K\. Xiong, X\. Guo, F\. Li, S\. Yan, G\. Xu, L\. Zhou, L\. Chen, H\. Sun, B\. Wang, K\. Ma, G\. Chen, H\. Ye, W\. Liu, and X\. WangReCogDrive: a reinforced cognitive framework for end\-to\-end autonomous driving\.External Links:2506\.08052,[Link](https://arxiv.org/abs/2506.08052)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.12.1)\.
- Liaoet al\.\(2025\)B\. Liao, S\. Chen, H\. Yin, B\. Jiang, C\. Wang, S\. Yan, X\. Zhang, X\. Li, Y\. Zhang, Q\. Zhang, and X\. WangDiffusionDrive: truncated diffusion model for end\-to\-end autonomous driving\.External Links:2411\.15139,[Link](https://arxiv.org/abs/2411.15139)Cited by:[Related Work](https://arxiv.org/html/2609.21486#Sx2.p3.1),[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.23.1)\.
- Shiet al\.\(2025\)C\. Shi, S\. Shi, K\. Sheng, B\. Zhang, and L\. JiangDriveX: omni scene modeling for learning generalizable world knowledge in autonomous driving\.External Links:2505\.19239,[Link](https://arxiv.org/abs/2505.19239)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.18.1)\.
- Simaet al\.\(2025\)C\. Sima, K\. Chitta, Z\. Yu, S\. Lan, P\. Luo, A\. Geiger, H\. Li, and J\. M\. AlvarezCentaur: robust end\-to\-end autonomous driving with test\-time training\.External Links:2503\.11650,[Link](https://arxiv.org/abs/2503.11650)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.28.1)\.
- Sunet al\.\(2024\)W\. Sun, X\. Lin, Y\. Shi, C\. Zhang, H\. Wu, and S\. ZhengSparseDrive: end\-to\-end autonomous driving via sparse scene representation\.External Links:2405\.19620,[Link](https://arxiv.org/abs/2405.19620)Cited by:[Related Work](https://arxiv.org/html/2609.21486#Sx2.p2.1)\.
- Wozniaket al\.\(2026\)M\. K\. Wozniak, L\. Liu, Y\. Cai, and P\. JensfeltPRIX: learning to plan from raw pixels for end\-to\-end autonomous driving\.External Links:2507\.17596,[Link](https://arxiv.org/abs/2507.17596)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.22.1)\.
- Xiaet al\.\(2026\)Q\. Xia, Z\. Shu, W\. Jiang, J\. Du, J\. Wang, and G\. LuDIVER:diving deeper into distilled data via expressive semantic recovery\.External Links:2605\.12649,[Link](https://arxiv.org/abs/2605.12649)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.24.1)\.
- Xieet al\.\(2026\)C\. Xie, C\. Sima, T\. Li, B\. Sun, J\. Wu, Z\. Hao, and H\. LiFLARE: learning future\-aware latent representations from vision\-language models for autonomous driving\.External Links:2601\.05611,[Link](https://arxiv.org/abs/2601.05611)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.14.1)\.
- Xinget al\.\(2025\)Z\. Xing, X\. Zhang, Y\. Hu, B\. Jiang, T\. He, Q\. Zhang, X\. Long, and W\. YinGoalFlow: goal\-driven flow matching for multimodal trajectories generation in end\-to\-end autonomous driving\.External Links:2503\.05689,[Link](https://arxiv.org/abs/2503.05689)Cited by:[Related Work](https://arxiv.org/html/2609.21486#Sx2.p3.1)\.
- Yaoet al\.\(2025\)W\. Yao, Z\. Li, S\. Lan, Z\. Wang, X\. Sun, J\. M\. Alvarez, and Z\. WuDriveSuprim: towards precise trajectory selection for end\-to\-end planning\.External Links:2506\.06659,[Link](https://arxiv.org/abs/2506.06659)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.29.1)\.
- Yeet al\.\(2023\)T\. Ye, W\. Jing, C\. Hu, S\. Huang, L\. Gao, F\. Li, J\. Wang, K\. Guo, W\. Xiao, W\. Mao, H\. Zheng, K\. Li, J\. Chen, and K\. YuFusionAD: multi\-modality fusion for prediction and planning tasks of autonomous driving\.External Links:2308\.01006,[Link](https://arxiv.org/abs/2308.01006)Cited by:[Architecture](https://arxiv.org/html/2609.21486#Sx3.SSx4.SSSx2.p1.1)\.
- Zenget al\.\(2025\)S\. Zeng, X\. Chang, M\. Xie, X\. Liu, Y\. Bai, Z\. Pan, M\. Xu, X\. Wei, and N\. GuoFutureSightDrive: thinking visually with spatio\-temporal cot for autonomous driving\.External Links:2505\.17685,[Link](https://arxiv.org/abs/2505.17685)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.8.1)\.
- Zhanget al\.\(2025\)W\. Zhang, C\. Liu, Y\. Pi, Y\. Zhang, H\. Huang, B\. Rao, Y\. Ding, S\. Yang, and J\. JiangDRAMA: a dynamic packet routing algorithm using multi\-agent reinforcement learning with emergent communication\.External Links:2504\.04438,[Link](https://arxiv.org/abs/2504.04438)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.20.1)\.
- Zhenget al\.\(2025\)Y\. Zheng, P\. Yang, Z\. Xing, Q\. Zhang, Y\. Zheng, Y\. Gao, P\. Li, T\. Zhang, Z\. Xia, P\. Jia, and D\. ZhaoWorld4Drive: end\-to\-end autonomous driving via intention\-aware physical latent world model\.External Links:2507\.00603,[Link](https://arxiv.org/abs/2507.00603)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.19.1)\.
- Zhouet al\.\(2025\)Z\. Zhou, T\. Cai, S\. Z\. Zhao, Y\. Zhang, Z\. Huang, B\. Zhou, and J\. MaAutoVLA: a vision\-language\-action model for end\-to\-end autonomous driving with adaptive reasoning and reinforcement fine\-tuning\.External Links:2506\.13757,[Link](https://arxiv.org/abs/2506.13757)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.9.1)\.
- Zhouet al\.\(2026\)Z\. Zhou, R\. Yang, Xuewei, Qi, Y\. Guo, S\. X\. Chen, T\. Feng, K\. Pistunova, Y\. Shen, L\. Su, and J\. MaSpanVLA: efficient action bridging and learning from negative\-recovery samples for vision\-language\-action model\.External Links:2604\.19710,[Link](https://arxiv.org/abs/2604.19710)Cited by:[Table 1](https://arxiv.org/html/2609.21486#Sx4.T1.1.11.1)\.相似文章
面向安全端到端自动驾驶的风险感知占用
本文提出风险感知占用作为端到端自动驾驶的安全密集表示,并介绍了ROIDrive网络和RiskOcc4D-nuScenes数据集,显著降低了碰撞率。
面向部分可观测环境下自动驾驶的统一风险地图学习
提出了一种面向部分可观测环境的自动驾驶统一风险地图建模框架,该框架通过时空建模和基于扩散的场景生成,整合了交通流风险和碰撞风险。在Waymo Open Motion数据集上,该方法优于最先进的遮挡感知基线。
DiDrive:一种用于自动驾驶安全离线强化学习的风险感知分层扩散框架
DiDrive是一种用于自动驾驶安全离线强化学习的风险感知分层扩散框架,通过集成表示学习和分布校正优化,提升复杂交通场景中的性能。
Reason--Imagine--Act:基于世界模型的闭环大语言模型决策在自动驾驶中的应用
提出了Reason-Imagine-Act (RIA),一种将大语言模型推理器与动作条件世界模型相结合的闭环框架,用于自动驾驶中的在线安全验证,在CARLA仿真中实现了80.05%的路线完成率和0.20%的碰撞率。
REARL:基于真实交通数据和大型语言模型的闭环自动驾驶模拟增强框架
本文提出了REARL,一个使用真实交通数据和大型语言模型的闭环框架,通过持续监控和调整车辆行为来增强自动驾驶模拟的真实性。