arXivDaily arXiv每日学术速递 周一至周五更新

大厂专区

BYD(比亚迪)

至 收录 4
2505.12311 2026-02-04 cs.RO

Scene-Adaptive Motion Planning with Explicit Mixture of Experts and Interaction-Oriented Optimization

场景自适应运动规划与显式专家混合及交互导向优化

Hongbiao Zhu, Liulong Ma, Xian Wu, Xin Deng, Xiaoyao Liang

机构 * Automotive New Technology Research Institute, BYD Company Limited(比亚迪公司自动驾驶新技术研究院)

AI总结 本文提出EMoE-Planner,通过显式专家混合和交互导向优化,解决复杂城市环境中自主驾驶轨迹规划的多模态、场景多样性和环境交互问题,实现超越传统规则算法的性能。

Comments Main text 10 pages with 7 figures

详情
AI中文摘要

尽管经过十多年的发展,复杂城市环境中自主驾驶轨迹规划仍面临重大挑战。这些挑战包括难以适应轨迹的多模态特性、单一专家模型在管理多样化场景中的局限性,以及对环境交互考虑不足。为了解决这些问题,本文引入了EMoE-Planner,其包含三种创新方法。首先,显式MoE(专家混合)通过共享场景路由器根据场景特定信息动态选择专门的专家。其次,规划器利用场景特定查询提供多模态先验,将模型的关注点引导至相关目标区域。最后,它通过考虑车辆与其它代理的交互来增强预测模型和损失计算,从而显著提升规划性能。在Nuplan数据集上与最先进方法进行了比较实验。模拟结果表明,我们的模型在几乎所有测试场景中都优于SOTA模型。我们的模型是第一个纯学习模型,几乎在所有Nuplan闭环模拟中实现了超越基于规则的算法的性能。

英文摘要

Despite over a decade of development, autonomous driving trajectory planning in complex urban environments continues to encounter significant challenges. These challenges include the difficulty in accommodating the multi-modal nature of trajectories, the limitations of single expert model in managing diverse scenarios, and insufficient consideration of environmental interactions. To address these issues, this paper introduces the EMoE-Planner, which incorporates three innovative approaches. Firstly, the Explicit MoE (Mixture of Experts) dynamically selects specialized experts based on scenario-specific information through a shared scene router. Secondly, the planner utilizes scene-specific queries to provide multi-modal priors, directing the model's focus towards relevant target areas. Lastly, it enhances the prediction model and loss calculation by considering the interactions between the ego vehicle and other agents, thereby significantly boosting planning performance. Comparative experiments were conducted on the Nuplan dataset against the state-of-the-art methods. The simulation results demonstrate that our model consistently outperforms SOTA models across nearly all test scenarios. Our model is the first pure learning model to achieve performance surpassing rule-based algorithms in almost all Nuplan closed-loop simulations.

URL PDF HTML 收藏
2602.02002 2026-02-03 cs.CV

UniDriveDreamer: A Single-Stage Multimodal World Model for Autonomous Driving

UniDriveDreamer: 一种用于自动驾驶的单阶段多模态世界模型

Guosheng Zhao, Yaozeng Wang, Xiaofeng Wang, Zheng Zhu, Tingdong Yu, Guan Huang, Yongchen Zai, Ji Jiao, Changliang Xue, Xiaole Wang, Zhen Yang, Futang Zhu, Xingang Wang

机构 * GigaAI CASIA BYD

AI总结 UniDriveDreamer是一种用于自动驾驶的单阶段多模态世界模型,通过统一的多模态生成方法提升视频和激光雷达数据合成的性能。

Comments 16 pages, 7 figures

详情
AI中文摘要

世界模型在自动驾驶的数据合成中展现出了显著的潜力。然而,现有方法大多集中在单模态生成上,通常侧重于多摄像头视频或激光雷达序列合成。在本文中,我们提出UniDriveDreamer,一种用于自动驾驶的单阶段统一多模态世界模型,该模型可以直接生成多模态的未来观测,而无需依赖中间表示或级联模块。我们的框架引入了一个专门针对激光雷达的变分自编码器(VAE),用于编码输入的激光雷达序列,以及一个视频VAE用于多摄像头图像。为了确保跨模态兼容性和训练稳定性,我们提出了统一潜在锚定(ULA),它明确对齐两种模态的潜在分布。对齐后的特征通过扩散变换器进行融合和处理,该变换器联合建模它们的几何对应关系和时间演变。此外,结构化的场景布局信息会按模态投影为条件信号以指导合成。大量实验表明,UniDriveDreamer在视频和激光雷达生成方面均优于先前的最先进方法,同时在下游任务中也产生了可测量的改进。

英文摘要

World models have demonstrated significant promise for data synthesis in autonomous driving. However, existing methods predominantly concentrate on single-modality generation, typically focusing on either multi-camera video or LiDAR sequence synthesis. In this paper, we propose UniDriveDreamer, a single-stage unified multimodal world model for autonomous driving, which directly generates multimodal future observations without relying on intermediate representations or cascaded modules. Our framework introduces a LiDAR-specific variational autoencoder (VAE) designed to encode input LiDAR sequences, alongside a video VAE for multi-camera images. To ensure cross-modal compatibility and training stability, we propose Unified Latent Anchoring (ULA), which explicitly aligns the latent distributions of the two modalities. The aligned features are fused and processed by a diffusion transformer that jointly models their geometric correspondence and temporal evolution. Additionally, structured scene layout information is projected per modality as a conditioning signal to guide the synthesis. Extensive experiments demonstrate that UniDriveDreamer outperforms previous state-of-the-art methods in both video and LiDAR generation, while also yielding measurable improvements in downstream

URL PDF HTML 收藏
2602.01277 2026-02-03 cs.CV

TF-Lane: Traffic Flow Module for Robust Lane Perception

TF-Lane:用于鲁棒车道感知的交通流模块

Yihan Xie, Han Xia, Zhen Yang

机构 * BYD Company Limited(比亚迪公司)

AI总结 TF-Lane通过引入交通流信息提升车道感知鲁棒性,实现在NuScenes数据集上mAP提升达4.1%

Comments 9 pages, 7 figures, 7 tables

详情
AI中文摘要

自动驾驶系统需要可靠的车道感知能力,但现有的基于视觉的检测方法在视觉传感器提供不足的场景下(如遮挡或车道缺失)会出现显著性能下降。虽然一些方法将高精度地图作为补充信息,但这些解决方案面临订阅成本高和实时性能有限的挑战。为了解决这些限制,我们探索了一个创新的信息源:交通流,它提供了无需额外成本的实时能力。本文提出了一种交通流感知的车道感知模块(TFM),能够有效提取实时交通流特征,并无缝整合到现有的车道感知算法中。该解决方案源于实际的自动驾驶环境,并随后在开源算法和数据集上进行了验证。在四个主流模型和两个公开数据集(NuScenes和OpenLaneV2)上进行的大量实验表明,TFM在标准评估指标下持续提升性能,最高在NuScenes数据集上实现+4.1%的mAP提升。

英文摘要

Autonomous driving systems require robust lane perception capabilities, yet existing vision-based detection methods suffer significant performance degradation when visual sensors provide insufficient cues, such as in occluded or lane-missing scenarios. While some approaches incorporate high-definition maps as supplementary information, these solutions face challenges of high subscription costs and limited real-time performance. To address these limitations, we explore an innovative information source: traffic flow, which offers real-time capabilities without additional costs. This paper proposes a TrafficFlow-aware Lane perception Module (TFM) that effectively extracts real-time traffic flow features and seamlessly integrates them with existing lane perception algorithms. This solution originated from real-world autonomous driving conditions and was subsequently validated on open-source algorithms and datasets. Extensive experiments on four mainstream models and two public datasets (Nuscenes and OpenLaneV2) using standard evaluation metrics show that TFM consistently improves performance, achieving up to +4.1% mAP gain on the Nuscenes dataset.

URL PDF HTML 收藏
2410.20913 2025-11-05 cs.LG cs.SY eess.SY

Constrained Optimal Fuel Consumption of HEVs under Observational Noise

Shuchang Yan, Haoran Sun

机构 * AI Technology Research and Development Department, Automotive New Technology Research Institute, BYD Auto Industry Company Limited(比亚迪汽车工业有限公司智能技术研究与开发部、汽车新技术研究院) Tsinghua University(清华大学)

Comments Minor text and figure adjustments; no substantive changes

详情
英文摘要

In our prior work, we investigated the minimum fuel consumption of a hybrid electric vehicle (HEV) under a state-of-charge (SOC) balance constraint, assuming perfect SOC measurements and accurate reference speed profiles. The constrained optimal fuel consumption (COFC) problem was addressed using a constrained reinforcement learning (CRL) framework. However, in real-world scenarios, SOC readings are often corrupted by sensor noise, and reference speeds may deviate from actual driving conditions. To account for these imperfections, this study reformulates the COFC problem by explicitly incorporating observational noise in both SOC and reference speed. We adopt a robust CRL approach, where the noise is modeled as a uniform distribution, and employ a structured training procedure to ensure stability. The proposed method is evaluated through simulations on the Toyota Prius hybrid system (THS), using both the New European Driving Cycle (NEDC) and the Worldwide Harmonized Light Vehicles Test Cycle (WLTC). Results show that fuel consumption and SOC constraint satisfaction remain robust across varying noise levels. Furthermore, the analysis reveals that observational noise in SOC and speed can impact fuel consumption to different extents. To the best of our knowledge, this is the first study to explicitly examine how observational noise -- commonly encountered in dynamometer testing and predictive energy control (PEC) applications -- affects constrained optimal fuel consumption in HEVs.

URL PDF HTML 收藏