Simulation is a crucial step in ensuring accurate, efficient, and realistic Connected and Autonomous Vehicles (CAVs) testing and validation. As the adoption of CAV accelerates, the integration of real-world data into simulation environments becomes increasingly critical. Among various technologies utilized by CAVs, Vehicle-to-Everything (V2X) communication plays a crucial role in ensuring a seamless transmission of information between CAVs, infrastructure, and other road users. However, most existing studies have focused on developing and testing communication protocols, resource allocation strategies, and data dissemination techniques in V2X. There is a gap where real-world V2X data is integrated into simulations to generate diverse and high-fidelity traffic scenarios. To fulfill this research gap, we leverage real-world Signal Phase and Timing (SPaT) data from Roadside Units (RSUs) to enhance the fidelity of CAV simulations. Moreover, we developed an algorithm that enables Autonomous Vehicles (AVs) to respond dynamically to real-time traffic signal data, simulating realistic V2X communication scenarios. Such high-fidelity simulation environments can generate multimodal data, including trajectory, semantic camera, depth camera, and bird's eye view data for various traffic scenarios. The generated scenarios and data provide invaluable insights into AVs' interactions with traffic infrastructure and other road users. This work aims to bridge the gap between theoretical research and practical deployment of CAVs, facilitating the development of smarter and safer transportation systems.
DragTraffic: Interactive and Controllable Traffic Scene Generation for Autonomous Driving
The Hong Kong University of Science and Technology(香港科技大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));KTH Royal Institute of Technology(瑞典皇家理工学院);Lotus Technology Ltd(路特斯科技有限公司)
TSC: Topology-Conditioned Stackelberg Coordination for Multi-Agent Reinforcement Learning in Interactive Driving
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Department of Natural Sciences, University of Durham(达勒姆大学自然科学系);College of Civil and Transportation Engineering, Shenzhen University(深圳大学土木与交通工程学院);Chair of Robotics, Artificial Intelligence and Realtime Systems, Technical University of Munich(慕尼黑技术大学机器人、人工智能与实时系统教授职位)
Versatile Behavior Diffusion for Generalized Traffic Agent Simulation
School of Mechanical and Aerospace Engineering, Nanyang Technological University(南洋理工大学机械与航空航天工程学院);Department of Electrical and Computer Engineering, Princeton University(普林斯顿大学电气与计算机工程系);NVIDIA Research(NVIDIA研究)
Human Observation-Inspired Trajectory Prediction for Autonomous Driving in Mixed-Autonomy Traffic Environments
University of Electronic Science and Technology of China(电子科技大学);University of Macau(澳门大学);Macau University of Science and Technology(澳门科技大学);Tsinghua University(清华大学)
TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarios
The University of Texas at Austin(德克萨斯大学奥斯汀分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);ETH Zurich(苏黎世联邦理工学院);The University of Edinburgh(爱丁堡大学)
Enhanced Mean Field Game for Interactive Decision-Making with Varied Stylish Multi-Vehicles
School of Mechanical Engineering, Shandong Huayu University of Technology(山东华宇科技大学机械工程学院);James Watt School of Engineering, University of Glasgow(格拉斯哥大学詹姆斯·瓦特工程学院);Computer science with the University of Minnesota - Twin Cities(明尼苏达大学双城分校计算机科学);Boston University(波士顿大学);Faculty of Computer Science and Information Technology, University of Malaya(马来亚大学计算机科学与信息技术学院);School of Computer Science and Technology, Taiyuan Normal University(太原师范学院计算机科学与技术学院);College of Mechanical Engineering, Chongqing University of Technology(重庆理工大学机械工程学院)
End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Driving
The Hong Kong University of Science and Technology(香港科技大学);University of California San Diego(加利福尼亚大学圣迭戈分校);The Hong Kong Polytechnic University(香港理工大学)
CARLA Real Traffic Scenarios -- novel training ground and benchmark for autonomous driving
University of Warsaw(华沙大学);Institute of Mathematics, Polish Academy of Sciences(波兰科学院数学研究所);Jagiellonian University(雅盖隆大学);Volkswagen AG(大众汽车集团);Google(谷歌)
Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Traffic
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);College of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Automation and Electrical Engineering, University of Science and Technology Beijing(北京科技大学自动化与电气工程学院)
Mean Field Game-Based Interactive Trajectory Planning Using Physics-Inspired Unified Potential Fields
School of Computing Science, University of Glasgow(格拉斯哥大学计算机科学学院);College of Mechanical Engineering, Chongqing University of Technology(重庆理工大学机械工程学院);Laboratory of Intelligent Home Appliances, College of Science and Technology, Ningbo University(宁波大学智能家电实验室)
Bench4Merge: A Comprehensive Benchmark for Merging in Realistic Dense Traffic with Micro-Interactive Vehicles
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));College of Energy Engineering, Zhejiang University(浙江大学能源工程学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Didi Chuxing(滴滴出行)
INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Maps
University of California, Berkeley(加州大学伯克利分校);Xi’an Jiaotong University(西安交通大学);Harbin Institute of Technology(哈尔滨工业大学);MINES ParisTech(巴黎高等矿业学院);FZI Research Center for Information Technology(FZI信息技术研究中心);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)
RoboMemory: A Brain-inspired Multi-memory Agentic Framework for Interactive Environmental Learning in Physical Embodied Systems
FNii-Shenzhen(FNii-深圳);SSE, CUHK-Shenzhen(SSE,CUHK-深圳);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));The University of Hong Kong(香港大学);National University of Singapore(新加坡国立大学);The Chinese University of Hong Kong(香港中文大学);Ising AI
Ethics-Aware Safe Reinforcement Learning for Rare-Event Risk Control in Interactive Urban Driving
Chair of Econometrics and Statistics Corresponding author esp. in the Transport Sector(计量经济学与统计学教授职位(交通运输领域特别对应作者));Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI)(可扩展数据与人工智能研究中心(ScaDS.AI))