arXivDaily arXiv每日学术速递 周一至周五更新

期刊&会议

International Conference on Machine Learning · 会议 · Machine Learning

2026-09-01 至 2026-09-01 共收录 18
2608.30295 2026-09-01 cs.LG cs.AI 新提交

CateKV: On Sequential Consistency for Long-Context LLM Inference Acceleration

CateKV:面向长上下文大语言模型推理加速的顺序一致性研究

Haoyun Jiang, Haolin Li, Jianwei Zhang, Fei Huang, Qiang Hu, Minmin Sun, Shuai Xiao, Yong Li, Junyang Lin, Jiangchao Yao

机构 * Shanghai Jiao Tong University(上海交通大学) Alibaba Group(阿里巴巴集团) Fudan University(复旦大学)

AI总结 本研究针对长上下文LLM推理的内存与延迟挑战,提出混合KV缓存方法CateKV,利用注意力头的顺序一致性特性减少冗余KV信息,在保持准确率的同时显著降低内存占用、提升解码与批量处理效率。

Comments Published at ICML 2025

Journal ref Proceedings of the 42nd International Conference on Machine Learning (ICML), PMLR 267:27569-27585, 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.29632 2026-09-01 cs.SE 新提交

InteractBench: Benchmarking LLMs on Competitive Programming under Unrevealed Information

InteractBench:针对未公开信息下的竞赛编程任务评估大语言模型(LLM)

Jiaze Li, Aocheng Shen, Bing Liu, Boyu Zhang, Xiaoxuan Fan, Qiankun Zhang, Xianjun Deng

AI总结 研究针对现有LLM竞赛编程基准的不足,推出含322道题的InteractBench基准,评估LLM在未公开信息交互式竞赛编程任务的表现,发现先进模型存在显著交互差距并提出失败分类法。

Comments Accepted at ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.29598 2026-09-01 cs.LG 新提交

On the Resilience of Text-to-Video Diffusion Models to Hardware Faults

文本到视频扩散模型对硬件故障的鲁棒性研究

Zachary Coalson, A M Aahad, Stella Doehring, Zane Ma, Sanghyun Hong

机构 * Oregon State University(俄勒冈州立大学)

AI总结 本研究首次系统性探究文本到视频(T2V)扩散模型对硬件故障的鲁棒性,发现单个故障可降低性能、改变语义,内存故障危害更大,揭示了已部署T2V系统的可靠性风险。

Comments Accepted to ICML 2026 Workshop on From Frames to Stories (F2S)

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.28725 2026-09-01 cs.AI 新提交

Beyond the Answer Key: Robustness Evaluation of Large Language Models for Step-Level Mathematical Verification

超越答案密钥:用于步骤级数学验证的大语言模型鲁棒性评估

Fateme Mazdarani, Carlos Toxtli

AI总结 本研究构建线性方程基准评估大语言模型的步骤级数学验证鲁棒性,发现开源模型对受扰动等价解题过程的错误拒绝率高,微调等方法可部分提升鲁棒性但存在权衡。

Comments Accepted to 2026 IEEE International Conference on Machine Learning and Applications (ICMLA)

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.28648 2026-09-01 cs.AI cs.CL cs.LG 新提交

How Language Models Choose Sides: Internal Representations of Instruction Hierarchy

语言模型如何选择立场:指令层级的内部表征

Enrique Balp-Straffon, Chih-Hao Hsu, Rushiraj Gadhvi, Sunishchal Dev, Callum Stuart McDougall, Anusha Mujumdar

机构 * Amazon(亚马逊) National Taiwan University(国立台湾大学) Plaksha University(普拉卡莎大学) RAND Corporation(兰德公司) Algoverse Google DeepMind(谷歌DeepMind)

AI总结 本研究探究指令微调LLM在系统与用户指令冲突中的仲裁机制,构建含41对约束的基准评估8个模型,发现反层级模型Llama-3.1-8B的冲突结果可从残差流激活线性解码,干预效果取决于读出几何结构。

Comments Published at the ICML 2026 Mechanistic Interpretability workshop, 16 pages (including appendix)

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.28633 2026-09-01 cs.CL cs.AI cs.CY 新提交

PAUSE: Editable Strategy Artifacts for Long-Form Cultural Story Adaptation

PAUSE:用于长篇文化故事改编的可编辑策略制品

Taaha Kazi, Vasu Sharma, Mohammad Saifullah, Abdur Rahman

AI总结 本研究提出PAUSE可编辑策略制品,用于控制长篇文化故事改编的文化决策,实验显示人类对该策略的编辑可有效传递到章节文本,提升了AI文化改编的可检查性与可争议性。

Comments 6 pages, 1 figure, 3 tables. Accepted at the 1st Workshop on Culture x AI: Evaluating AI as a Cultural Technology, ICML 2026. Project page: https://abdur75648.github.io/pause/

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.28600 2026-09-01 cs.AI 新提交

SHAPE of Chain-of-Thought in Math Reasoning

数学推理中思维链的SHAPE

Jonghyun Song, Sangjun Song, Minjae Oh, Haesung Pyun, Sungsik Lee, Yohan Jo

AI总结 本研究提出用于分析LLM思维链轨迹的\texttt{SHAPE}框架,发现数学启发式比传统CoT特征更能解释答案正确性,基于此的后训练可提升LLM数学推理准确率。

Comments accepted to The 3rd AI for Math Workshop at ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.02575 2026-09-01 cs.CV cs.AI 版本更新

Criterion-Conditional In-Context Learning: Evaluating Criterion-Shift Adaptation in Vision-Language Models

标准条件上下文学习:评估视觉语言模型中的标准转移适应性

Kaiyun Yang, Ruilin Yang, Zhimin Yao, Jikai Wang, Wei Ge

机构 * Megvii Technology Inc., Beijing, China(美科科技有限公司,北京,中国)

AI总结 研究提出标准条件上下文学习(CC-ICL)新设置,模型需从上下文推断潜在标准并据此调整预测。为此提出两个评估指标,构建CC-Bench基准。实验发现多数模型有边界偏差,简单多标准训练可改善。

Comments Accepted by ICML 2026. Code is available at https://github.com/MegviiAlgo-Team/CC-ICL

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.26857 2026-09-01 cs.LG 版本更新

Generalist Graph Anomaly Detection via Prototype-Based Distillation

基于原型蒸馏的通才图异常检测

Yiming Xu, Zihan Chen, Zhen Peng, Song Wang, Bin Shi, Bo Dong, Chao Shen

机构 * School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, China(西安交通大学计算机科学与技术学院) National Engineering Research Center for Visual Information and Applications, Xi'an, China(视觉信息与应用国家工程研究中心) University of Virginia, Charlottesville, USA(弗吉尼亚大学) University of Central Florida, Orlando, USA(佛罗里达大学) School of Distance Education, Xi’an Jiaotong University, Xi'an, China(西安交通大学继续教育学院) School of Cyber Science and Engineering, Xi'an Jiaotong University, Xi'an, China(西安交通大学网络安全学院)

AI总结 提出首个无监督通才图异常检测框架ProMoS,通过知识蒸馏从冻结的自监督图神经网络教师模型中提取正常性先验,并利用原型引导的软标签蒸馏实现跨图零样本异常检测。

Comments Accepted by ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.29720 2026-09-01 cs.CV cs.LG

Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets

面向大规模人脸识别数据集的高效、免验证的内在质量评估

Zhichao Chen, Yongle Zhao, Kaicheng Yang, Meng Yang, Yin Xie, Ziyong Feng

机构 * School of Cyber Science and Technology, University of Science and Technology of China(中国科学技术大学网络科学与技术学院)

AI总结 提出一种无需训练的内在质量(IQ)指标,通过邻域一致性得分和全局表示子空间复杂度来估计人脸识别数据集生成高性能模型的潜力,实现快速数据集诊断与筛选。

Comments ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.04545 2026-09-01 cs.LG math.ST stat.TH 版本更新

Branch Scaling Manifests as Implicit Architectural Regularization for Improving Generalization in Overparameterized ResNets

分支缩放表现为隐式架构正则化以改善过参数化ResNet的泛化能力

Zixiong Yu, Guhan Chen, Jianfa Lai, Bohan Li, Songtao Tian

机构 * Huawei Large Model Data Technology Lab, Shenzhen(华为大模型数据技术实验室,深圳) Tsinghua University, Beijing(清华大学,北京) Kyoto University, Kyoto(京都大学,京都)

AI总结 本文研究残差网络中分支缩放因子对过参数化ResNet泛化性能的影响,通过理论分析证明快速深度衰减的缩放因子结合早停可实现极小极大最优泛化率,并利用神经正切核(NTK)近似解释其机制。

Comments Accepted by ICML 2026. This version incorporates content from the preprint arXiv:2305.18506. The contributors of the relevant content have consented to its inclusion and have been listed as authors

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.19597 2026-09-01 cs.LG stat.ML

The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence

对比表示学习的几何力学:对齐势、熵分散和跨模态散度

Yichao Cai, Zhen Zhang, Yuhang Liu, Javen Qinfeng Shi

机构 * University of Science and Technology of China(中国科学技术大学)

AI总结 本文通过测度论框架,在大批量极限下证明InfoNCE目标与确定性能量景观的等价性,揭示单模态与对称多模态之间的几何分岔,并指出跨模态散度项导致模态间隙。

Comments Accepted at ICML 2026; v8: Exposition and notation refined; results unchanged

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.13155 2026-09-01 cs.CV 版本更新

Pareto-Guided Optimal Transport for Multi-Reward Alignment

基于帕累托前沿的多奖励对齐最优传输

Ying Ba, Tianyu Zhang, Mohan Zhou, Yalong Bai, Wenyi Mo, Guiwei Zhang, Bing Su, Ji-Rong Wen

机构 * Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China(中国人民大学北京校区人工智能学院) Beijing Key Laboratory of Research on Large Models(北京大模型研究关键实验室) Engineering Research Center of Next-Generation Intelligent Search(下一代智能搜索与推荐工程技术研究中心) Rutgers University(罗格斯大学)

AI总结 本文提出帕累托前沿引导的最优传输框架,通过构建任务特定的帕累托前沿并利用分布感知最优传输将支配样本映射到前沿,结合在线和离线优化策略,引入联合支配率和联合坍塌率作为评估指标,实验显示在多奖励协同和对抗攻击中优于基线方法。

Comments Accepted to ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.23865 2026-09-01 cs.LG cs.AI stat.ML 版本更新

Inverting Foundation Models of Brain Function with Simulation-Based Inference

通过基于模拟的推断翻转脑功能基础模型

Niels Leif Bracher, Xavier Intes, Stefan T. Radev

机构 * Center for Modeling, Simulation, \& Imaging in Medicine, Rensselaer Polytechnic Institute, NY, USA

AI总结 研究通过TRIBEv2验证了能否从合成脑活动恢复刺激属性,利用大语言模型生成刺激参数,展示了基础脑模型在逆向设计中的应用潜力。

Comments Accepted at the ICML 2026 Workshop on Structured Probabilistic Inference & Generative Modeling

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.07120 2026-09-01 cs.CL 版本更新

Anchored Decoding: Provably Reducing Copyright Risk for Any Language Model

锚定解码:可证明降低任何语言模型的版权风险

Jacqueline He, Jonathan Hayase, Wen-tau Yih, Sewoong Oh, Luke Zettlemoyer, Pang Wei Koh

机构 * University of Washington(华盛顿大学) Allen Institute for Artificial Intelligence(人工智能研究院)

AI总结 提出锚定解码,一种即插即用的推理时方法,通过将生成内容约束在许可训练的安全模型附近,可证明地抑制语言模型逐字复制受版权保护的内容,实现可调的风险-效用权衡。

Comments Accepted to ICML 2026. 53 pages, 14 figures, 22 tables. Code is publicly available at https://github.com/jacqueline-he/anchored-decoding

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.03448 2026-09-01 cs.SD cs.AI cs.MM eess.AS 版本更新

SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering

SonicMaster:迈向可控的全方位音乐修复与母带处理

Jan Melechovsky, Ambuj Mehrish, Abhinaba Roy, Dorien Herremans

机构 * Information Systems Technology and Design(信息系统技术与设计)

AI总结 SonicMaster通过基于文本的控制,实现了音乐修复与母带处理的统一生成模型,显著提升了音频质量。

Journal ref Proceedings of ICML, 2026, Seoul, South Korea

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.21799 2026-09-01 cs.LG 版本更新

The Double-Edged Nature of the Rashomon Set for Trustworthy Machine Learning

拉索蒙集在可信机器学习中的双刃剑性质

Ethan Hsu, Harry Chen, Chudi Zhong, Lesia Semenova

机构 * Duke University(杜克大学) MIT(麻省理工学院) UNC-Chapel Hill(北卡罗来纳大学教堂山分校) Rutgers University(罗格斯大学)

AI总结 研究揭示了拉索蒙集在可信机器学习中的双刃剑性质,指出其在提升鲁棒性的同时也带来隐私风险。

Comments Accepted to ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.00030 2026-09-01 cs.LG cs.AI 版本更新

RSPO: Regularized Self-Play Alignment of Large Language Models

RSPO:大语言模型的正则化自博弈对齐

Xiaohang Tang, Sangwoong Yoon, Seongho Son, Huizhuo Yuan, Quanquan Gu, Ilija Bogunovic

机构 * University College London(伦敦大学学院) University of California, Los Angeles(加州大学洛杉矶分校)

AI总结 本研究提出RSPO框架,统一现有方法并保证收敛性,在多个基准测试中提升了自博弈微调LLMs的性能,为正则化自博弈对齐提供了基础。

Comments Accepted at ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏