arXivDaily arXiv每日学术速递 周一至周五更新

大厂专区

NVIDIA(英伟达)

2026-05-19 至 2026-05-19 共收录 12
2605.18748 2026-05-19 cs.CV

Aurora: Unified Video Editing with a Tool-Using Agent

Aurora: 一种基于工具使用的统一视频编辑框架

Yongsheng Yu, Ziyun Zeng, Zhiyuan Xiao, Zhenghong Zhou, Hang Hua, Wei Xiong, Jiebo Luo

机构 * MIT-IBM(MIT-IBM研究院) NVIDIA(NVIDIA公司)

AI总结 本文提出Aurora框架,通过结合增强的视觉语言模型(VLM)代理和统一视频扩散变换器,解决视频编辑中的文本和视觉不充分问题,提升了视频编辑的灵活性和准确性。

Comments Code: https://github.com/yeates/Aurora

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.18530 2026-05-19 cs.CL cs.AI cs.LG stat.ML

Continuous Diffusion Scales Competitively with Discrete Diffusion for Language

连续扩散在语言领域中能与离散扩散竞争性地扩展

Zhihan Yang, Wei Guo, Shuibai Zhang, Subham Sekhar Sahoo, Yongxin Chen, Arash Vahdat, Morteza Mardani, John Thickstun

机构 * NVIDIA & Cornell(NVIDIA与康奈尔大学) NVIDIA & Georgia Tech(NVIDIA与佐治亚理工学院) UW-Madison(威斯康星大学麦迪逊分校) MBZUAI-IFM(梅兰德大学-IFM) Cornell(康奈尔大学)

AI总结 本文研究了连续扩散模型在语言建模中的扩展能力,通过改进Plaid模型构建RePlaid,证明连续扩散模型在计算效率和性能上可与离散模型竞争,并提供了理论支持。

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.09413 2026-05-19 cs.SD cs.AI cs.CL cs.MA eess.AS

Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception

Speech-Hands: 一种基于自我反思的语音代理方法用于语音识别和多感知音频推理

Zhen Wan, Chao-Han Huck Yang, Jinchuan Tian, Hanrong Ye, Ankita Pasad, Szu-wei Fu, Arushi Goel, Ryo Hachiuma, Shizhe Diao, Kunal Dhawan, Sreyan Ghosh, Yusuke Hirota, Zhehuai Chen, Rafael Valle, Chenhui Chu, Shinji Watanabe, Yu-Chiang Frank Wang, Boris Ginsburg

机构 * NVIDIA Kyoto University(京都大学) Carnegie Mellon University(卡内基梅隆大学)

AI总结 本文提出Speech-Hands框架,通过自我反思决策机制解决语音识别和外部声音理解任务中的信任问题,提升了模型在多任务音频推理中的准确性和鲁棒性。

Comments Accepted to ACL 2026. Oral Presentation. Code: https://github.com/YukinoWan/Speech-Hands OpenClaw Branch: https://github.com/openclaw/openclaw/pull/69073

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.17559 2026-05-19 stat.ME cs.AI q-bio.QM stat.ML

Controlling False Discovery in Arbitrarily Structured Hypothesis Spaces via Reproducing Kernels

通过再生核来控制任意结构假设空间中的假发现

Binyamin Perets, Shie Mannor

机构 * Technion – Israel Institute of Technology(技术Ion – 以色列理工学院) NVIDIA

AI总结 本文提出了一种基于再生核的框架,用于在任意结构的假设空间中控制假发现率,通过将结构FDR控制转化为正则化学习问题,实现了对连续域、图和层次结构的统一处理,提高了发现能力。

Comments 9 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.01123 2026-05-19 cs.LG cs.AI

Learning from Historical Activations in Graph Neural Networks

在图神经网络中学习历史激活

Yaniv Galron, Hadar Sinai, Haggai Maron, Moshe Eliasof

机构 * Technion – Israel Institute of Technology(技术ion–以色列理工学院) NVIDIA Ben-Gurion University of the Negev(贝内-约尔根大学) University of Cambridge(剑桥大学)

AI总结 本文提出HISTOGRAPH,一种基于注意力的两阶段最终聚合层,通过层间和节点间的注意力机制,利用节点的激活历史和图结构来优化最终预测特征,从而在多个图分类基准上实现了优于传统方法的性能。

Comments ICLR 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.17077 2026-05-19 cs.RO cs.AI

How to Instruct Your Robot: Dense Language Annotations Power Robot Policy Learning

如何指导你的机器人:密集语言标注助力机器人策略学习

Bosung Kim, Ruiyi Wang, David Acuna, Jaehun Jung, Alexander Trevithick, Brandon Cui, Yejin Choi, Prithviraj Ammanabrolu

机构 * University of California, San Diego(加州大学圣地亚哥分校) NVIDIA

AI总结 本研究通过密集语言标注提升机器人策略学习效率,提出DeMiAn方法,利用视觉语言模型生成多方面标注,提升策略和世界模型性能,无需新增演示数据。

详情

展开后加载摘要…

URL PDF HTML 收藏
2603.18178 2026-05-19 cs.CV cs.AI

VLM-AutoDrive: Post-Training Vision-Language Models for Safety-Critical Autonomous Driving Events

VLM-AutoDrive: 事后训练视觉-语言模型用于安全关键的自动驾驶事件

Mohammad Qazim Bhat, Yufan Huang, Niket Agarwal, Hao Wang, Michael Woods, John Kenyon, Tsung-Yi Lin, Xiaodong Yang, Ming-Yu Liu, Kevin Xie

机构 * NVIDIA

AI总结 本文提出VLM-AutoDrive框架,通过整合元数据生成的描述、LLM生成的描述、视觉问答对和推理监督,提升预训练视觉语言模型在安全关键自动驾驶事件中的检测性能。

Comments 16 pages, 9 figures, submitted to arXiv

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.08167 2026-05-19 cs.RO cs.AI cs.CV cs.LG

Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoning

基于互联网规模知识的自监督行动预测具身推理

Milan Ganai, Katie Luo, Jonas Frey, Clark Barrett, Marco Pavone

机构 * Stanford(斯坦福大学) UC Berkeley(加州大学伯克利分校) NVIDIA(英伟达)

AI总结 本文提出R&B-EnCoRe方法,通过自监督细化使模型从互联网知识中自推导具身推理策略,提升动作执行和导航性能,减少碰撞率。

Comments Robotics: Science and Systems (RSS) 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.18941 2026-05-19 cs.CL cs.AI cs.LG

ProfBench: Multi-Domain Rubrics requiring Professional Knowledge to Answer and Judge

ProfBench:需要专业知识回答和评判的多领域评分标准

Zhilin Wang, Jaehun Jung, Ximing Lu, Shizhe Diao, Ellie Evans, Jiaqi Zeng, Pavlo Molchanov, Yejin Choi, Jan Kautz, Yi Dong

机构 * NVIDIA

AI总结 ProfBench通过7000多个由专业领域专家评估的响应-评分对,评估大语言模型在处理专业文档、信息整合和生成综合报告方面的能力,揭示了即使顶级模型在专业任务上也面临挑战。

Comments Published at ICLR 2026, 30 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.21319 2026-05-19 cs.CL cs.AI cs.LG

RLBFF: Binary Flexible Feedback to bridge between Human Feedback & Verifiable Rewards

RLBFF:二进制灵活反馈用于连接人类反馈与可验证奖励

Zhilin Wang, Jiaqi Zeng, Olivier Delalleau, Ellie Evans, Daniel Egert, Hoo-Chang Shin, Felipe Soares, Yi Dong, Oleksii Kuchaiev

机构 * NVIDIA

AI总结 RLBFF结合人类偏好与规则验证,提升奖励模型对响应质量的精准捕捉,优于Bradley-Terry模型,在RM-Bench和JudgeBench上取得优异成绩,且支持用户自定义反馈原则。

Comments Published at ICLR 2026, 21 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.07152 2026-05-19 cs.CV

Intuitive Surgical SurgToolLoc and SurgVU Challenges Results: 2022-2025

直观外科SurgToolLoc和SurgVU挑战结果:2022-2025

Aneeq Zia, Max Berniker, Rogerio Garcia Nespolo, Xiaorui Zhang, Conor Perreault, Kiran Bhattacharyya, Xi Liu, Ziheng Wang, Satoshi Kondo, Satoshi Kasai, Kousuke Hirasawa, Bo Liu, David Austin, Yiheng Wang, Michal Futrega, Jean-Francois Puget, Zhenqiang Li, Yoichi Sato, Ryo Fujii, Ryo Hachiuma, Mana Masuda, Hideo Saito, An Wang, Mengya Xu, Mobarakol Islam, Long Bai, Winnie Pang, Hongliang Ren, Chinedu Nwoye, Luca Sestini, Nicolas Padoy, Maximilian Nielsen, Samuel Schüttler, Thilo Sentker, Hümeyra Husseini, Ivo Baltruschat, Rüdiger Schmitz, René Werner, Aleksandr Matsun, Mugariya Farooq, Numan Saaed, Jose Renato Restom Viera, Mohammad Yaqub, Neil Getty, Fangfang Xia, Zixuan Zhao, Xiaotian Duan, Xing Yao, Ange Lou, Hao Yang, Jintong Han, Jack Noble, Jie Ying Wu, Tamer Abdulbaki Alshirbaji, Nour Aldeen Jalal, Herag Arabian, Ning Ding, Knut Moeller, Weiliang Chen, Quan He, Muhammad Bilal, Taofeek Akinosho, Adnan Qayyum, Massimo Caputo, Hunaid Vohra, Michael Loizou, Anuoluwapo Ajayi, Ilhem Berrou, Faatihah Niyi-Odumosu, Charlie Budd, Oluwatosin Alabi, Tom Vercauteren, Ruoxi Zhao, Ayberk Acar, John Han, Jumanh Atoum, Yinhong Qin, Surong Hua, Lu Ping, Wenming Wu, Rongfeng Wei, Jinlin Wu, You Pang, Zhen Chen, Tim Jaspers, Amine Yamlahi, Piotr Kalinowski, Dominik Michael, Tim Rädsch, Marco Hübner, Danail Stoyanov, Stefanie Speidel, Lena Maier-Hein, Jie Tian, Ruxin Zhang, Khang Hoang Nguyen, Anh Quoc Nguyen, Tam Minh Nguyen, Khoi Dinh Tran, Minh Nguyen Dang Nhat, Trinh Thi Doan Pham, Linh Van Nguyen, Chunyang Jiang, Dewei Yang, Haitao Li, Yannick Prudent, Thibaut Boissin, Mahmood Alam, Shazad Ashraf, Andrew D. Beggs, Lukman Akanbi, Manuel D. Delgado, Narain Gupta, Amir M. Hajiyavand, Iqbal Qasim, Hafiz A. Alaka, Junaid Qadir, Shu Yang, Yihui Wang, Hao Chen, Shin Paul, Yosuke Yamagishi, Zhang Dong, Hongyun Li, Hongyu Gu, Xiaoliu Ding, Xiaoyao Liu, Xingyu Zhao, Mariana Ribeiro, Tiago Jesus, André Ferreira, Guilherme Barbosa, João Carvalho, Leonardo Barroso, Nuno Gomes, Rafael Peixoto, Rodrigo Ralha, Victor Alves, Stephanie, Nattapat Ittikosil, Achita Chitrapan, Quan Huu Cap, Jiayuan Huang, Shreyas C Dhake, Sergi Kavtaradze, Mobarak I Hoque, Ka Young Kim, Su Yong Yun, Young Tae Kim, Hyeon Bae Kim, Seong Tae Kim, Zuxing Deng, Ling Li, Jieyu Zheng, Xiaojian Li, Anthony Jarc

机构 * Intuitive Surgical, Inc.(Intuitive Surgical公司) Muroran Institute of Technology(Muroran理工学院) Niigata University of Health and Welfare Fujita Health University(Niigata大学健康与福利大学 Fujita健康大学) NVIDIA, Inc.(NVIDIA公司) University of Tokyo(东京大学) Keio University(Keio大学) Shun Hing Institute of Advanced Engineering(Shun Hing先进工程研究所) NUS NUSRI SZ(新加坡大学 NUSRI SZ) University of Strasbourg IHU Strasbourg(斯特拉斯堡大学 IHU斯特拉斯堡) University Medical Center Hambrug-Eppendorf(汉堡-埃彭多夫大学医学中心)

AI总结 本文总结了2022-2025年间在机器人辅助手术中解决手术工具定位和手术视觉理解的挑战成果,探讨了相关机器学习问题的解决方法与贡献。

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.07272 2026-05-19 cs.CV cs.GR

VideoNeuMat: Neural Material Extraction from Generative Video Models

VideoNeuMat: 从生成视频模型中提取神经材料

Bowen Xue, Saeed Hadadan, Zheng Zeng, Fabrice Rousselle, Zahra Montazeri, Milos Hasan

机构 * University of Manchester(曼彻斯特大学) NVIDIA(NVIDIA公司) University of California Santa Barbara(加州大学圣巴bara分校)

AI总结 VideoNeuMat通过两阶段流程从视频扩散模型中提取可重用的神经材料,利用可控相机和光照轨迹生成材料样本视频,并通过大型重建模型重建紧凑的神经材料,实现超越合成训练数据的现实感和多样性。

详情

展开后加载摘要…

URL PDF HTML 收藏