arXivDaily arXiv每日学术速递 周一至周五更新

University Research

高校专区

按论文英文发表机构汇总 AI、计算机相关高校的最新研究成果。

2026-07-21 至 2026-07-21 收录 398
2605.04445 2026-07-21 cs.CV 版本更新

LEGO: LoRA-Enabled Generator-Oriented Framework for Synthetic Image Detection

LEGO:用于合成图像检测的基于LoRA的面向生成器框架

Yutong Xiao, Ran Ran, Jiwei Wei, Shuchang Zhou, Ke Liu, Zheng Ziqiang, Caiyan Qin

机构 * University of Electronic Science and Technology of China(电子科技大学) Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))

AI总结 针对生成技术使合成图像难辨真伪,现有检测方法存在泛化和过拟合问题,提出LEGO框架。通过MLP调制多个LoRA模块,分两阶段训练,能提取特定生成器独特伪影,在少数据和少轮次训练下性能优于现有方法。

Comments 10 pages,2 figures

详情
AI中文摘要

生成技术的快速发展使得合成图像几乎与真实图像难以区分,因此迫切需要强大的检测器来应对错误信息。现有方法主要依赖于多个生成器共享的通用伪影特征,但随着生成器多样性增加,这些共同特征的重叠逐渐减少,严重损害模型泛化能力,而仅关注独特伪影又易导致过拟合。为此提出LEGO框架,其核心机制是用MLP调制多个LoRA模块,各模块预训练以捕获特定生成器的独特伪影,再进行基于注意力的特征融合。LEGO将训练过程分为两个阶段,把独特伪影提取委托给专门的LoRA模块。每个LoRA模块在单生成器数据集上单独训练以学习特定生成器表示,然后MLP和注意力层在混合数据集上训练以动态调节各模块贡献。受益于模块化且强大的设计,LEGO可通过纳入新的LoRA模块自然扩展以适应新出现的下一代数据集,在训练图像数量少、训练数据占比低且训练轮次少的情况下,仍比现有最优方法性能大幅提升。

英文摘要

The rapid advancement of generative technologies has made synthetic images nearly indistinguishable from real ones, thereby creating an urgent need for robust detectors to counter misinformation. However, existing methods mainly rely on universal artifact features that are shared across multiple generators. We observe that as the diversity of generators increases, the overlap of these common features gradually decreases. This severely undermines model generalization. In contrast, focusing only on unique artifacts tends to cause overfitting to specific forgery patterns. To address this challenge, we propose LEGO (LoRA-Enabled Generator-Oriented Framework). The core mechanism of LEGO employs an MLP to modulate multiple LoRA (Low-Rank Adaptation) blocks, each pretrained to capture the unique artifacts of a specific generator, followed by attention-based feature fusion. Unlike conventional methods that seek a single universal solution, LEGO delegates unique artifact extraction to specialized LoRA modules by dividing its training procedure into two stages. Each LoRA module is individually trained on a single-generator dataset to learn generator-specific representations, then MLP and attention layers are trained on mixed datasets to dynamically regulate the contribution of each module. Benefiting from its modular yet robust design, LEGO can be naturally extended by incorporating new LoRA modules for adaptation to newly emerging next-generation datasets, while still achieving substantially better performance than prior SOTA methods with fewer than 30,000 training images, less than 10% of their training data, and only 5 epochs in each training stage.

URL PDF HTML 收藏
2607.18119 2026-07-21 stat.ML cs.LG 新提交

COVAriance-Induced Fairness Gap Penalty for Subgroup-Fair Clustering

用于子群公平聚类的协方差诱导公平差距惩罚

Kyungseon Lee, Hankyo Jeong, Kunwoong Kim, Kwanho Lee, Yongdai Kim

机构 * Department of Statistics, Seoul National University(首尔国立大学统计系) KAIST AI(韩国科学技术院人工智能研究所)

AI总结 研究在多敏感属性定义多个子群时的公平聚类问题,提出基于协方差诱导公平差距惩罚的方法,推导代理并连续松弛,扩展框架捕捉子群 - 边际公平差距,实验证明算法在成本 - 公平权衡上有竞争力且提高计算效率。

详情
AI中文摘要

公平聚类旨在使聚类分配与敏感属性无关,但当多个敏感属性共同定义多个子群时,这一目标颇具挑战。直接扩展现有公平聚类算法计算成本高或数值不稳定,尤其是子群数量呈指数增长且部分子群实例很少时。为应对这些挑战,我们定义了聚类的子群公平差距并推导了基于协方差的代理,它与该差距完全匹配。接着引入代理的连续松弛,实现基于梯度的高效优化并得出算法COVA - FC。我们还表明子群公平并不意味着边际公平,并扩展框架以捕捉子群 - 边际公平差距。基准数据集实验表明,COVA - FC在成本 - 公平权衡方面具有竞争力,且在子群和高阶边际设置中提高了计算效率。

英文摘要

Fair clustering aims to make cluster assignments independent of sensitive attributes, but this goal becomes challenging when multiple sensitive attributes jointly define many subgroups. In such settings, directly extending existing fair clustering algorithms is computationally expensive or numerically unstable, especially when the number of subgroups grows exponentially and some subgroups contain only a few instances. To address these challenges, we define a subgroup-fairness gap for clustering and derive a covariance-based surrogate that exactly matches this gap. We then introduce a continuous relaxation of the surrogate, enabling efficient gradient-based optimization and yielding our proposed algorithm, COVA-FC. We also show that subgroup fairness alone does not imply marginal fairness, and extend our framework to capture a subgroup-marginal-fairness gap. Experiments on benchmark datasets show that COVA-FC achieves competitive cost-fairness trade-offs and improves computational efficiency over existing baselines in both subgroup and higher-order marginal settings.

URL PDF HTML 收藏
2607.17201 2026-07-21 stat.ML cs.LG 新提交

Non-Asymptotic Best Policy Identification Guarantees in Online Reinforcement Learning

在线强化学习中的非渐近最优策略识别保证

Joseph Lazzaro, Alessio Russo, Aldo Pacchiano

机构 * Imperial College London(伦敦帝国学院) Boston University(波士顿大学) Broad Institute of MIT and Harvard(MIT和哈佛大学Broad研究所)

AI总结 研究在线表格强化学习中的最优策略识别问题,通过为导航与停止(NaS)算法提供非渐近样本复杂度保证,揭示其样本复杂度不仅依赖特征时间,还与MDP连通性等有关,填补了相关空白。

Comments 64 pages, 2 figures

详情
AI中文摘要

在这项工作中,我们研究在线表格强化学习中的最优策略识别(BPI)问题。这是一个主动序贯假设检验问题,学习者的目标是以高置信度识别马尔可夫决策过程(MDP)中的最优策略,同时最小化预期样本复杂度。我们考虑具有确定性奖励的在线设置,智能体必须策略性地在MDP中导航以有效探索。先前文献为BPI提供了渐近最优方法,如导航与停止(NaS)算法及其变体,但现有分析仍是渐近的。我们通过为NaS提供首个非渐近样本复杂度保证来填补这一空白,表明其样本复杂度不仅取决于特征时间,还取决于基础MDP的连通性、最优特征时间的曲率以及其他依赖实例的量。我们识别出这些额外属性并明确它们对整体样本复杂度的贡献。

英文摘要

In this work we study the Best Policy Identification (BPI) problem in online, tabular Reinforcement Learning. This is an active sequential hypothesis testing problem in which the learner's objective is to identify an optimal policy in a Markov Decision Process (MDP) with high confidence, while minimizing the expected sample complexity to do so. We consider an online setting with deterministic rewards, where the agent must strategically navigate through the MDP in order to effectively explore. Previous works in the literature have provided asymptotically optimal methods for BPI, such as the Navigate and Stop (NaS) algorithm and its variants, however existing analysis remains asymptotic. In this work, we fill that gap by providing the first non-asymptotic sample complexity guarantees for NaS, showing that its sample complexity depends not only on the characteristic time, but also on the connectivity of the underlying MDP, the curvature of the optimal characteristic time, and other instance-dependent quantities. We identify these additional attributes and make explicit their contributions to the overall sample complexity.

URL PDF HTML 收藏
2607.16877 2026-07-21 eess.SP cs.LG 新提交

Hierarchical Wireless Foundation Model for Multi-Task Optimization

用于多任务优化的分层无线基础模型

Yangjing Wang, Ouya Wang, Shenglong Zhou, Geoffrey Ye Li

机构 * Department of Electrical and Electronic Engineering, Faculty of Engineering, Imperial College London(电气与电子工程系,工程学院,伦敦帝国理工学院) School of Mathematics and Statistics, Beijing Jiaotong University(数学与统计学学院,北京交通大学)

AI总结 针对下一代无线网络中人工智能技术泛化瓶颈问题,提出分层无线基础模型(WFM),通过几何感知交叉注意力耦合上下游模块,采用混合训练策略,实现多任务优化,学习高保真信道表示,降低延迟,有强大泛化能力。

Comments 15 pages, 10 figures, 3 tables

详情
AI中文摘要

下一代无线网络日益复杂,推动了人工智能融入无线通信。但现有多数研究专注单场景特定任务深度学习技术,限制了跨任务、信道条件和系统配置的泛化能力。为此提出分层无线基础模型(WFM)用于多任务优化,通过几何感知交叉注意力将上游基础信道编码器(FCE)与下游基础优化解码器(FOD)耦合。FCE经自监督掩码重建提取与任务无关的信道表示,FOD通过可微输出头生成多任务优化决策。采用混合监督到无监督训练策略克服纯监督学习性能上限,其模块化架构能高效适应未见通信任务且参数开销小。仿真结果表明,该模型能学习高保真信道表示,实现有竞争力的多任务优化性能,大幅降低优化推理延迟,对未见传播环境、变化约束参数和异构系统配置有强大泛化能力。

英文摘要

The increasing complexity of next-generation wireless networks has driven the integration of artificial intelligence (AI) into wireless communications. However, most existing studies focus on developing task-specific deep learning techniques for single scenarios, which limits their ability to generalize across diverse tasks, channel conditions, and system configurations. To address this generalization bottleneck, we propose a hierarchical wireless foundation model (WFM) for multi-task optimization. The proposed WFM couples an upstream foundation channel encoder (FCE) with a downstream foundation optimization decoder (FOD) via geometry-aware cross-attention. Specifically, the FCE extracts task-agnostic channel representations via self-supervised masked reconstruction while the FOD generates multi-task optimization decisions through differentiable output heads. Moreover, a hybrid supervised-to-unsupervised training strategy is employed to overcome the performance ceiling of purely supervised learning, and the modular architecture of the WFM enables efficient adaptation to unseen communication tasks with minimal parameter overhead. Simulation results show that the proposed WFM learns high-fidelity channel representations and achieves competitive multi-task optimization performance while substantially reducing optimization inference latency relative to numerical baselines. Furthermore, it exhibits robust generalization to unseen propagation environments, varying constraint parameters, and heterogeneous system configurations.

URL PDF HTML 收藏
2607.16229 2026-07-21 stat.AP cs.LG q-fin.CP q-fin.PM 新提交

FinBench: Time-Gated Calibration and Uncertainty Benchmarking for Agentic Financial Forecasting

FinBench:用于智能金融预测的时间门控校准与不确定性基准测试

Rishab Ghosh, Vinay Devarakonda

机构 * UT Austin(得克萨斯大学)

AI总结 介绍用于金融预测的FinBench基准,它通过时间门控避免前瞻偏差,用适当评分规则评估。任务要求模型输出正回报概率和预测区间,用多种分数评估,通过小型试点运行展示校准敏感指标能区分不同预测行为。

Comments 9 pages, 3 figures

详情
AI中文摘要

大语言模型越来越多地被用作观察、规划和行动的智能系统组件。在金融领域,一旦其输出用于确定交易规模或分配风险,即使是“辅助”系统也会与决策相关。一个关键的失败模式是置信度与能力差距:一个仅略优于随机猜测但持续过度自信的模型,在典型的投注规模规则下,将产生负的长期增长。现有基准强调语义理解或点准确性,但未在定义真实市场的时间约束和非平稳性下直接测试概率校准。我们引入了FinBench,这是一个旨在评估金融预测校准和不确定性质量的基准,它(i)严格设置时间门控以避免前瞻性偏差,(ii)使用严格适当的评分规则进行评估,对虚假置信度进行惩罚。FinBench任务要求模型输出(a)正回报的概率和(b)实现对数回报的80%预测区间;评估使用Brier分数、Winkler区间分数以及针对硬基线的技能分数。本文描述了基准规范,并报告了一次小型试点运行(一个交易日;三个流动性股票代码;33次预测)作为对流程的合理性检查。试点说明了校准敏感指标如何区分“自信但脆弱”的行为和不确定性感知预测。

英文摘要

Large language models (LLMs) are increasingly used as components of agentic systems that observe, plan, and act. In finance, even "assistive" systems become decision-relevant once their outputs are used to size trades or allocate risk. A key failure mode is the confidence--competence gap: a model that is only slightly better than chance but consistently overconfident will, under typical bet-sizing rules, generate negative long-run growth. Existing benchmarks emphasize semantic understanding or point accuracy, but do not directly test probabilistic calibration under the temporal constraints and non-stationarity that define real markets. We introduce FinBench, a benchmark designed to evaluate calibration and uncertainty quality for financial forecasting in a setting that is (i) strictly time-gated to avoid look-ahead bias and (ii) evaluated with strictly proper scoring rules that penalize hallucinated confidence. FinBench tasks require models to output (a) a probability of positive return and (b) an 80% prediction interval for realized log return; evaluation uses the Brier score and the Winkler interval score, along with skill scores against hard baselines. This paper describes the benchmark specification and reports a small pilot run (one trading day; three liquid tickers; 33 forecasts) as a sanity check of the pipeline. The pilot illustrates how calibration-sensitive metrics distinguish between "confident but fragile" behavior and uncertainty-aware forecasting.

URL PDF HTML 收藏
2607.18236 2026-07-21 cs.RO cs.LG 新提交

Patch Policy: Efficient Embodied Control via Dense Visual Representations

补丁策略:通过密集视觉表示实现高效具身控制

Gaoyue Zhou, Zichen Jeff Cui, Ada Langford, Bowen Tan, Yann LeCun, Lerrel Pinto

机构 * Courant Institute, New York University(纽约大学柯朗数学科学研究所) Meta-FAIR(Meta FAIR) AMI Labs(AMI 实验室)

AI总结 研究利用预训练密集视觉特征,提出补丁策略,通过块因果注意力掩码等实现高效具身控制。该策略轻量级、快速且高效,在模拟和真实环境中相比其他策略有显著提升,为机器人社区利用视觉表示学习提供新途径。

详情
AI中文摘要

来自视觉Transformer(ViT)的预训练密集视觉特征强大但在机器人学习中未得到充分利用。现代机器人策略要么将每个观察压缩为单个全局令牌,要么依赖从头训练的视觉主干,牺牲了细粒度空间细节和大规模视觉预训练的好处。虽然存在像大型视觉语言动作模型(VLA)那样对密集补丁特征进行操作的策略,但它们往往繁重且缓慢。我们用补丁策略弥合了这一差距,它是一种最小的架构扩展,使基于Transformer的策略能够直接使用密集预训练补丁令牌,而无需完整VLM的计算开销。其核心是一个块因果注意力掩码,在保留标准策略时间因果关系的同时,让模型在每次观察时关注多个补丁令牌以及其他状态信息。补丁策略轻量级、快速且高效。在四个模拟和三个真实世界环境套件中,我们的方法比使用最先进全局池化表示的策略实现了40%的相对改进。此外,它在使用约0.7%参数的情况下,比微调后的OpenVLA - OFT高出18%。我们相信补丁策略为机器人社区提供了一个管道,以便在不牺牲高频反应控制所需的训练效率或推理速度的情况下,轻松利用视觉表示学习的持续进展。视频可在此https URL查看

英文摘要

Pretrained dense visual features from Vision Transformers (ViTs) are powerful yet have been underutilized in robot learning. Modern robot policies either compress each observation into a single global token, or rely on visual backbones trained from scratch, sacrificing both fine-grained spatial detail and the benefits of large-scale visual pre-training. While there exist policies that do operate on dense patch features like large vision-language-action models (VLAs), they tend to be heavy and slow, inheriting the full cost of a billion-parameter vision-language model (VLM) backbone. We close this gap with Patch Policy, a minimal architectural extension that enables transformer-based policies to consume dense pre-trained patch tokens directly without the computational overhead of a full VLM. At its core is a block-causal attention mask that preserves the temporal causality of standard policies while letting the model attend over many patch tokens per observation, alongside other state information. Patch Policy is lightweight, fast, and highly effective. Across four simulated and three real-world environment suites, our method achieves a 40% relative improvement over policies using state-of-the-art global-pooled representations. Furthermore, it surpasses fine-tuned OpenVLA-OFT by 18% while using roughly 0.7% of the parameters. We believe Patch Policy provides a pipeline for the robotics community to readily leverage continuing progress in visual representation learning, without sacrificing the training efficiency or inference speed required for high-frequency, reactive control. Videos can be viewed at https://patch-policy.github.io

URL PDF HTML 收藏
2607.18232 2026-07-21 cs.CL 新提交

It's Not What You Say, It's How You Say It: Evaluating LLM Responses to Expressions of Belief

重要的不是你说了什么,而是你怎么说:评估大语言模型对信念表达的回应

Kevin Du, Clara Kümpel, Michelle Wastl, Alex Warstadt

机构 * ETH Zürich(苏黎世联邦理工学院) University of Zurich(苏黎世大学) UC San Diego(加州大学圣地亚哥分校)

AI总结 研究用户信念表达形式对大语言模型的影响,引入基于语言维度的类型学,生成可控查询对,评估不同架构、规模和训练阶段的16个LLMs,发现响应行为差异及能显著说服模型的特定信念表达,揭示语言框架对模型情境整合的影响。

Comments Published at ACL 2026

详情
AI中文摘要

用户经常向大语言模型(LLMs)表达他们的信念。在某些情况下,LLM应该接受这些情境信念为真。在其他情况下,它们应坚持其先验知识。用户的信念表达(EoBs)在语言形式上多种多样,使用预设、证据和确定性标记或不同语调等,每种形式对LLMs的说服力可能不同。我们引入一种类型学来系统评估不同EoBs如何影响模型遵循情境还是先验知识。该类型学基于四个语言维度:形式、证据性、认知立场和语调,涵盖17种细粒度类型。通过将这些EoBs与世界知识事实配对,生成可控的EoB查询对以分离语言变化的影响。使用此基准评估16个在架构、规模和训练阶段不同的LLMs。我们识别出这些方面响应行为的有意义差异,还确定了比其他EoBs更能显著说服LM的特定EoBs。我们的工作揭示了语言框架影响LLM情境整合的系统模式,对提示工程和模型鲁棒性有影响。

英文摘要

Users frequently express their beliefs to large language models (LLMs). In some situations, the LLM should accept these contextual beliefs as true. In others, they should stick to their prior knowledge. Notably, users' expressions of belief (EoBs) can take linguistically diverse forms - using presuppositions, evidential and certainty markers, or varied tones - each of which may have a different persuasiveness over the LLMs. We introduce a typology to systematically evaluate how different EoBs affect whether models follow context versus prior knowledge. The typology is grounded in four linguistically motivated dimensions: form, evidentiality, epistemic stance, and tone, spanning 17 fine-grained types. By pairing these EoBs with world knowledge facts, we generate controlled EoB-query pairs that isolate the effect of linguistic variation. Using this benchmark, we evaluate 16 LLMs that differ in architecture (Llama3, Qwen3, Gemma3), scale (1B-30B parameters), and training stages (base vs instruct). We identify meaningful variations in response behavior across these axes, e.g., that bigger models and instruction models tend to be less context-following than smaller models and base models. We further identify specific EoBs that statistically significantly persuade LMs more consistently than others. Our work reveals systematic patterns in how linguistic framing affects LLM context integration, with implications for prompt engineering and model robustness.

URL PDF HTML 收藏
2607.18231 2026-07-21 cs.RO 新提交

FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulation

FM-VLA:用于接触丰富操作中视觉-语言-动作模型的基于力的记忆

Ruicheng Li, Qixiu Li, Ruichun Ma, Yu Deng, Lin Luo, Zhiying Du, Jianfeng Xiang, Huizhi Liang, Ruicheng Wang, Jiaolong Yang, Baining Guo

机构 * Tsinghua University(清华大学) Microsoft Research(微软研究院) Fudan University(复旦大学) USTC(中国科学技术大学)

AI总结 研究针对视觉-语言-动作模型在接触丰富操作中的时间上下文推理问题,提出FM-VLA模型,通过基于力的记忆编码及投影,利用累积接触事件历史指导操作,在相关任务上评估,轻量级力记忆表现出色,显著优于基线方法。

详情
AI中文摘要

视觉-语言-动作(VLA)模型在机器人操作中实现了令人印象深刻的泛化,近期基于记忆增强的VLA通过以过去图像或语言摘要为条件放宽了马尔可夫假设。基于视觉的记忆方法通过对采样的过去图像帧进行条件设定来解决此问题,但在时间事件视觉模糊时计算成本高且有根本限制。我们提出FM-VLA,一种具有基于力的记忆的VLA模型,用于非马尔可夫、接触丰富操作的时间上下文推理。我们用变分自编码器(VAE)将力历史编码为紧凑的力记忆令牌,VAE通过力时间序列重建进行预训练。通过将力潜在表示和短状态历史投影为动作专家模块的额外条件令牌,使VLA能够利用累积的接触事件历史来指导操作。我们在三个依赖记忆的任务上评估FM-VLA,包括找到隐藏块、按按钮和擦拭盘子特定次数。我们的轻量级力记忆以最小推理开销实现了超过80%的成功率,显著优于基线方法。

英文摘要

Vision-language-action (VLA) models have achieved impressive generalization in robotic manipulation, and recent memory-augmented VLAs have relaxed the Markovian assumption by conditioning on past images or language summaries. Vision-based memory approaches address this by conditioning on sampled past image frames, but they are computationally expensive and fundamentally limited when temporal events are visually ambiguous, e.g., pushing a button multiple times with small movements. We propose FM-VLA, a VLA model with force-based memory, enabling temporal context reasoning for non-Markovian, contact-rich manipulation. We encode force histories into compact force memory tokens with a variational autoencoder (VAE) pretrained with force time series reconstruction. By projecting force latent representations and short state history as additional conditioning tokens to the action expert module, we enable VLAs to leverage accumulated contact event history to guide manipulation. We evaluate FM-VLA on three memory-dependent tasks, including finding a hidden block, pressing a button, and wiping a dish for a specific number of times. Our lightweight force memory achieves over 80% success rate with minimal inference overhead, significantly outperforming baseline approaches. Project page: https://qft-333.github.io/FM-VLA-Page/

URL PDF HTML 收藏
2607.18228 2026-07-21 cs.AI cs.CL 新提交

Logical Judgments Under Pressure: Diagnosing Syllogistic Stability with Learned Soft Prefixes

压力下的逻辑判断:用学习到的软前缀诊断三段论稳定性

Brian K Chen

机构 * National University of Singapore(新加坡国立大学)

AI总结 研究在三段论推理基准前加软前缀,探究学习到的上下文压力对模型逻辑判断的影响,发现软前缀能改变正确答案,在多模型测试中效果优于随机对照,主要影响是答案偏好,不同模型有显著差异。

Comments 41 pages, 6 figures

详情
AI中文摘要

为测试正确的逻辑判断如何响应学习到的上下文,我们在一个精确标注的三段论推理基准前添加软前缀,同时保持模型不变。软前缀是不透明的连续向量,通过它们在逻辑形式和接口的受控变化中引发的行为来表征。通过研究哪些前缀成功及其效果如何泛化,我们刻画了学习到的上下文压力如何推翻正确判断并揭示模型逻辑稳定性的局限性。在多个模型上,学习到的前缀改变了许多正确答案,在未见过的形式和接口变化中依然有效,且在多次测试中优于随机对照。诊断测试表明,主要影响是对一种答案含义的广泛偏好,不同模型的这种偏差形式不同。这些结果表明,成功的软前缀的主要行为影响是广泛的答案偏好,同时其余响应揭示了逻辑稳定性方面模型特定的显著差异。

英文摘要

To test how correct logical judgments respond to learned context, we prepend a soft prefix to an exactly labeled syllogistic reasoning benchmark while keeping the model fixed. Soft prefixes are opaque continuous vectors, so we characterize them through the behavior they induce across controlled variations in logical form and interface. By studying which prefixes succeed and how their effects generalize, we characterize how learned contextual pressure can override correct judgments and expose limits in a model's logical stability. Across Qwen3.6-35B-A3B MoE, Qwen3-8B, and Gemma 4 31B, learned prefixes redirect many correct answers and remain effective across unseen forms and interface changes. In repeated tests with Qwen3.6 MoE and Gemma, they outperform paired random controls in all 16 model--direction--split comparisons by 37 to 99 percentage points. Qwen3.6 MoE flip rates remain between 72% and 90% across wording and prompt changes, while Gemma validity prefixes retain 54% to 56% flip compared with less than 1% for matched random prefixes. Diagnostic tests show that the dominant effect is a broad preference for one answer meaning rather than fixed-symbol forcing or a logical operation that transfers reliably between tasks. The form of this bias differs across models. In both Qwen models, simple score models often predict which judgments will flip but not how far their margins will move, whereas Gemma's overall response is more closely approximated by the same models. These results show that the dominant behavioral effect of successful soft prefixes is a broad answer preference, while the remaining response reveals substantial model-specific differences in logical stability.

URL PDF HTML 收藏
2607.18218 2026-07-21 cs.CV cs.AI 新提交

GigaPath-Flash and GigaTIME-Flash: Efficient Pathology Foundation Models for Whole-Slide and Tumor Microenvironment Analysis

GigaPath-Flash和GigaTIME-Flash:用于全切片和肿瘤微环境分析的高效病理学基础模型

Naoto Usuyama, Jeya Maria Jose Valanarasu, Sicong Yao, Hanwen Xu, Jaspreet Bagga, Guanghui Qin, Robert E. Kramer, Cliff Wong, Soohee Lee, Hao Qiu, Theodore Zhengde Zhao, Racheli Ben Shimol, Angela Crabtree, Kevin Matlock, Eduardo Alejandro Lozano Garcia, Naiteek Sangani, Alberto Santamaria-Pang, Jason Entenmann, Alexandra Q. Bartlett, Bill J. Wright, Bernard A. Fox, Brian Piening, Sheng Zhang, Sheng Wang, Tristan Naumann, Carlo Bifulco, Hoifung Poon

机构 * Microsoft Research(微软研究院) Paul G. Allen School of Computer Science and Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院) Providence Genomics(普罗维登斯基因组学公司) Earle A. Chiles Research Institute, Providence Cancer Institute(普罗维登斯癌症研究所厄尔·A·奇尔斯研究所) Providence Research Network(普罗维登斯研究网络)

AI总结 研究针对计算病理学中模型局限,提出GigaPath-Flash和GigaTIME-Flash模型用于全切片和肿瘤微环境分析。前者结合特定编码器,计算量少性能优;后者扩展架构预测肿瘤免疫微环境,速度快内存省,共同为相关领域提供开放许可模型及权重。

Comments Models: https://aka.ms/gigapath-flash (GigaPath-Flash) and https://aka.ms/gigatime-flash (GigaTIME-Flash)

详情
AI中文摘要

基础模型已成为计算病理学的驱动力,有潜力通过从大规模组织病理学数据中学习可转移表示来改变癌症诊断、预后和治疗选择。然而,大多数预训练模型仅在图像块级别运行,使用受限许可证且计算成本高,限制了大规模切片级临床和研究应用。本文介绍了GigaPath-Flash和GigaTIME-Flash,用于全切片病理学AI和空间蛋白质组学预测的高效模型。GigaPath-Flash结合了在大规模真实世界组织病理学数据上预训练的22M参数ViT-S块编码器和21M参数LongNet切片编码器,其紧凑块编码器从十亿参数GigaPath(ViT-g)教师模型中提炼而来。GigaPath-Flash以少50倍的计算量保留了GigaPath 97%的平均切片级性能。GigaTIME-Flash扩展此架构以直接从常规H&E图像预测肿瘤免疫微环境,在预测质量上超越了基于CNN的原始GigaTIME,速度快6倍且GPU内存使用少8倍。这些模型与GigaPath和GigaTIME一起形成了一个基于大规模真实世界临床数据预训练的、开放权重且遵循Apache-2.0许可的模型家族。通过发布所有模型和权重,为计算病理学、免疫肿瘤学和精准健康提供了可访问的构建模块。

英文摘要

Foundation models have emerged as a driving force in computational pathology, with the potential to transform cancer diagnosis, prognosis, and treatment selection by learning transferable representations from large-scale histopathology data. A growing landscape of pathology foundation models now spans diverse data sources, architectures, and downstream applications. However, most pretrained models operate only at the image-tile level, use restrictive licenses, and remain computationally expensive, limiting large-scale slide-level clinical and research use. Here, we introduce GigaPath-Flash and GigaTIME-Flash, efficient models for whole-slide pathology AI and spatial proteomics prediction. GigaPath-Flash combines a 22M-parameter ViT-S tile encoder with a 21M-parameter LongNet slide encoder, both pretrained on large-scale real-world histopathology data. Its compact tile encoder is distilled from the billion-parameter GigaPath (ViT-g) teacher and shared by both models. GigaPath-Flash retains 97% of GigaPath's average slide-level performance with 50x less compute. GigaTIME-Flash extends this backbone to predict the tumor immune microenvironment directly from routine H&E images. It surpasses the original CNN-based GigaTIME in prediction quality while running 6x faster and using 8x less GPU memory. Together with GigaPath and GigaTIME, these models form an open-weight, Apache-2.0-licensed family pretrained on large-scale real-world clinical data. By releasing all models and weights, we provide accessible building blocks for computational pathology, immuno-oncology, and precision health.

URL PDF HTML 收藏
2607.18217 2026-07-21 cs.CV 新提交

HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enchancement

HOMIE:通过多模态智能增强实现以人为对象的视频个性化

Yiyang Cai, Nan Chen, Rongchang Xie, Junwen Pan, Chunyang Jiang, Cheng Chen, Wen Zhou, Zhenbang Sun, Wei Xue, Wenhan Luo, Yike Guo

机构 * Hong Kong University of Science and Technology(香港科技大学)

AI总结 研究以人为对象的视频个性化问题,提出HOMIE框架,统一处理主体间和主体内输入设置。通过更好的MLLM集成策略、自注意力中的全局多模态引导及模态参考嵌入,在多任务中达最优性能。

Comments 28 pages, 14 figures

详情
AI中文摘要

以人为对象的视频个性化(HOCVP)是主题驱动视频生成中的核心任务。现有方法存在两个关键局限。多数关注主体间个性化的方法难以在高主体保真度与人和多样物体间准确交互模式间平衡,尤其物体为抽象概念如图标时。虽主体内参考有望增强保真度,但多数现有工作缺乏理解潜在对应关系的机制。为应对这些挑战,我们提出HOMIE框架,统一处理主体间和主体内输入设置。与先前方法相比,HOMIE提出更好的MLLM集成策略,在不影响文本编码器可控性或产生高成本重新对齐的情况下提取参考级关系知识。具体而言,我们在自注意力中引入全局多模态引导,更好地对齐MLLM语义特征与VAE令牌;还提出模态参考嵌入来区分MLLM特征和VAE令牌并关联主体内参考图像令牌。大量实验验证了该方法在各种HOCVP任务中达到了当前最优性能。

英文摘要

Human-object centric video personalization (HOCVP) is a core task within subject-driven video generation. However, existing methods suffer from two key limitations. First, most approaches focusing on inter-subject personalization still struggle to strike a balance between high subject fidelity and accurate interaction patterns between humans and diverse objects, especially when objects represent abstract concepts such as logos. Second, while intra-subject references (e.g., OCR maps, multi-view inputs) are expected to enhance subject fidelity, most existing works lack mechanisms to understand such latent correspondence. To address both challenges, we propose HOMIE, an HOCVP framework that tackles both inter- and intra-subject input settings in a unified manner. Compared to previous approaches, HOMIE proposes a better MLLM integration strategy to extract knowledge of reference-level relationships without compromising the controllability of text encoders or incurring costly re-alignment. Specifically, we introduce global multimodal guidance within self-attention to better align MLLM-derived semantic features with VAE tokens. Furthermore, we propose modality-reference embedding to differentiate tokens from MLLM features and VAE tokens and associate intra-subject reference image tokens. Extensive experiments validate that our method achieves state-of-the-art performance across various HOCVP tasks. Project Page: https://yiyangcai.github.io/homie-page.github.io/

URL PDF HTML 收藏
2607.18200 2026-07-21 cs.RO cs.AI 新提交

Learning Adaptive Safety Margins for Visual Navigation

学习用于视觉导航的自适应安全裕度

Junyi Hu, Shuaihang Yuan, Geeta Chandra Raju Bethala, Anthony Tzes, Yi Fang

机构 * New York University Abu Dhabi(纽约大学阿布扎比分校)

AI总结 研究针对室内机器人视觉导航中安全裕度校准问题,提出上下文条件安全评论家方法,通过分解的三个互补项学习自适应间隙偏好排序扩散提议,经训练和提炼后在导航任务中表现出色,还能转移到人形机器人。

详情
AI中文摘要

在杂乱的室内空间中,机器人失败往往不是因为无法生成无碰撞路径,而是固定安全裕度校准不当。基于扩散的规划器能从自中心RGB-D生成多样轨迹候选,但可靠选择仍是瓶颈。我们提出一种上下文条件安全评论家,学习自适应间隙偏好来对扩散提议排序,分解为三个互补项:安全项、效率项和距离约束匹配项。在模拟中用特权ESDF几何训练评论家,通过两阶段师生过程提炼为仅感知选择器。在PointGoal导航任务中,该方法在强扩散、优化和RL基线中取得最高成功率和成功加权路径长度,还能转移到Unitree G1人形机器人且无需特定任务调整。

英文摘要

Robots in cluttered indoor spaces often fail not because they cannot generate collision-free paths, but because a fixed safety margin is mis-calibrated: conservative margins cause detours and timeouts, while permissive margins lead to near-boundary shortcuts under perception bias. Diffusion-based planners propose diverse trajectory candidates from egocentric RGB-D, yet reliable selection remains the bottleneck. We propose a context-conditioned safety critic that learns an adaptive clearance preference for ranking diffusion proposals, decomposed into three complementary terms: (i) a safety term with a clearance-budget penalty and a control-barrier-function residual for waypoint- and transition-wise safety, (ii) an efficiency term combining a smoothness penalty with a safety-gated detour-ratio penalty that avoids detours without incentivizing risky shortcuts, and (iii) a distance-constraint matching term that anchors the learned budget to realized ESDF clearances to prevent margin collapse. We train the critic with privileged ESDF geometry in simulation and distill it into a perception-only selector via a two-stage teacher-student procedure. On PointGoal navigation in HM3D and MP3D, including cross-dataset transfer, our method achieves the highest success rate (SR) and success weighted by path length (SPL) among strong diffusion, optimization, and RL baselines. Trained purely in simulation, it transfers to a Unitree G1 humanoid and navigates cluttered indoor scenes without task-specific tuning.

URL PDF HTML 收藏
2607.18198 2026-07-21 cs.LG cs.CV 新提交

Three-Body Scattering for Generative Modeling

用于生成建模的三体散射

Peng Sun, Zhenglin Cheng, Deyuan Liu, Jun Xie, Xinyi Shang, Tao Lin

机构 * Westlake University(西湖大学) Zhejiang University(浙江大学) University College London(伦敦大学学院)

AI总结 研究提出三体散射建模(TBSM)用于生成,将能量距离转化为特定相互作用,为单步生成器提供监督。通过在线跟踪条件期望减少噪声,在ImageNet-256上训练单步生成器取得良好结果,确立了跟踪散射作为高维单步生成的途径。

Comments 31 pages, 5 figures, and 4 tables. Code: https://github.com/sp12138/TBSM

详情
AI中文摘要

现代生成模型通常依赖对抗性判别器、规定的噪声到数据路径或自回归分解。相反,我们表明适当的分布能量可以诱导样本级运动,并为单步生成器提供直接回归监督。用于生成的三体散射建模(TBSM)将能量距离转化为每个射弹的固定大小相互作用:每个射弹被一个真实源吸引并被一个独立生成的源排斥。基于射弹及其条件,其期望等于$\frac12D_E^2(P_{\theta},Q)$的2-瓦瑟斯坦梯度流速度。一批$B$个冻结目标事件产生$O(B)$个样本级损失,每个损失使用一个参考作为其条件,而不是像漂移模型等方法使用的小批量全对场。在线跟踪这种条件期望可以减少场噪声。使用冻结图像特征中的散射,TBSM在ImageNet-256上训练单步生成器,在NFE = 1时,像素空间的PixelDiT-XL实现FID = 2.23,潜在空间的DiT-XL实现FID = 1.63。我们提供了一个设计图,将扩散相关监督、类似漂移的动力学和类似GAN的目标联系起来。这些结果将跟踪散射确立为高维单步生成的一条途径。代码:此https URL。

英文摘要

Modern generative models typically rely on an adversarial critic, a prescribed noise-to-data path, or an autoregressive factorization. Instead, we show that a proper distributional energy can induce sample-level motion and provide direct regression supervision for a one-step generator. Three-Body Scattering Modeling (TBSM) for generation turns the energy distance into a constant-size per-projectile interaction: each projectile is attracted toward one real source and repelled from one independently generated source. Conditioned on the projectile and its condition, its expectation equals the $2$-Wasserstein gradient-flow velocity of $\frac12D_E^2(P_θ,Q)$. A batch of $B$ frozen-target events yields $O(B)$ sample-level losses, each using one reference for its condition instead of the minibatch-wide all-pairs field used by methods such as Drifting Models. Tracking this conditional expectation online can reduce field noise. Using scattering in frozen image features, TBSM trains one-step generators on ImageNet-256, achieving FID${}=2.23$ with pixel-space PixelDiT-XL and FID${}=1.63$ with latent-space DiT-XL at NFE${}=1$. We provide a design map relating diffusion-related supervision, Drift-like dynamics, and GAN-like objectives. These results establish tracked scattering as a route to high-dimensional one-step generation. Code: https://github.com/sp12138/TBSM.

URL PDF HTML 收藏
2607.18195 2026-07-21 cs.CV cs.LG 新提交

Certified Training for Convolutional Perturbations

卷积扰动的认证训练

Benedikt Brückner, Alessio Lomuscio

机构 * Safe Intelligence(安全智能) Imperial College London(伦敦帝国理工学院)

AI总结 研究视觉模型受扰动问题,提出利用卷积扰动编码的认证训练方法,显著优于对抗训练,在CIFAR10上对运动模糊有超80%鲁棒准确率,且标准准确率相当。

详情
AI中文摘要

视觉模型易受运行时相机抖动引起的运动模糊等扰动影响,这阻碍了它们在关键应用中的部署。数据增强或对抗训练等方法缺乏形式安全保证。我们引入一种新颖的认证训练方法,利用卷积扰动的高效编码来训练可证明鲁棒的模型。该方法显著优于对抗训练,在CIFAR10上对合理强度运动模糊的鲁棒准确率超过80%,同时保持相当的标准准确率。

英文摘要

Vision models have been found to be susceptible to perturbations such as motion blur induced at runtime by a shaking camera. This impedes their deployment in critical applications since phenomena such as slightly blurred vision might lead to failures, for example an object detector missing objects. While methods such as data augmentation or Adversarial Training can improve empirical robustness, they lack formal safety guarantees, making it difficult to identify and mitigate hidden vulnerabilities. We introduce a novel Certified Training approach that leverages an efficient encoding of convolutional perturbations to train provably robust models. Our method significantly outperforms Adversarial Training, achieving, for example, over 80% robust accuracy against motion blur of reasonable intensity on CIFAR10 while maintaining comparable standard accuracy.

URL PDF HTML 收藏
2607.18181 2026-07-21 cs.CL cs.SE 新提交

VEHBench: A Stage-Local Diagnostic Benchmark for LLM-Assisted Vibration Energy Harvester Design

VEHBench:用于大语言模型辅助振动能量采集器设计的阶段局部诊断基准测试

Depeng Su, Yuyu Luo, Guobiao Hu

机构 * The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))

AI总结 研究针对无电池物联网中振动能量采集器设计,引入VEHBench基准测试,评估大语言模型在耦合物理设计不同阶段的表现,通过763个任务及四个设计角色测试,发现模型能力依赖阶段,为评估、选择等工程大语言模型提供阶段感知基础。

详情
AI中文摘要

无电池物联网需要在耦合物理约束下对振动能量采集器进行迭代设计,而大语言模型正成为工程工作流程的接口层。然而,现有的工程基准测试主要评估最终工件的有效性,对于大语言模型在耦合物理设计的不同阶段的表现提供的见解有限。我们引入了VEHBench,这是一个用于大语言模型辅助振动能量采集器设计的工程原生诊断基准测试,具有763个基于文献的任务,并由一个分析物理预言机评分。VEHBench评估四个设计角色:规范分类、验证器引导搜索、损坏状态恢复和策略条件选择。实验结果表明,大语言模型的能力强烈依赖于阶段:没有一个单一模型能在整个工作流程中始终占据主导地位,并且响应控制配置文件揭示了不同设计角色之间不同的行为模式。因此,VEHBench为评估、选择、路由和改进基于验证器的工程大语言模型提供了一个阶段感知基础。基准工件可在这个https URL上获取。

英文摘要

Battery-free Internet of Things (IoT) requires iterative design of vibration energy harvesters (VEHs) under coupled physical constraints, while LLMs are emerging as interface layers for engineering workflows. However, existing engineering benchmarks primarily assess final artifact validity, offering limited insights into how LLMs behave across different stages of coupled physical design. We introduce VEHBench, an engineering-native diagnostic benchmark for LLM-assisted VEH design, featuring 763 literature-grounded tasks scored by an analytical physical oracle. VEHBench evaluates four design roles: specification triage, verifier-guided search, corrupted-state recovery, and policy-conditioned selection. Experimental results reveal that LLM capability is strongly stage-dependent: no single model consistently dominates the entire workflow, and response-control profiles expose distinct behavioral patterns across design roles. VEHBench thus provides a stage-aware foundation for evaluating, selecting, routing, and improving verifier-grounded engineering LLMs. The benchmark artifact is available at https://huggingface.co/datasets/AnonymousVehbench/vehbench

URL PDF HTML 收藏
2607.18171 2026-07-21 cs.LG 新提交

FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications

FlashRT:用于引导智能体部署实时多模态应用的智能体框架

Krish Agarwal, Zhuoming Chen, Yanyuan Qin, Zhenyu Gu, Atri Rudra, Beidi Chen

机构 * Carnegie Mellon University(卡内基梅隆大学) AMD(超威半导体公司) University at Buffalo(纽约州立大学水牛城分校)

AI总结 研究实时多模态应用部署难题,提出FlashRT智能体框架。通过新范式引导编码智能体多阶段转换,将参考实现转为高效部署,在不同GPU上显著提升性能,尤其在专家优化不成熟平台更具扩展性。

详情
AI中文摘要

实时多模态应用,如语音智能体和交互式视频生成,将异构模型组合成管道,其高效部署需要针对放置、流和模型内并行性做出特定于应用的决策。现有服务系统和自动并行编译器的转换有限且工作量假设固定。我们提出了FlashRT,一种智能体框架,它引导编码智能体将简单的开发者编写的参考实现提升为优化的多GPU部署,灵活权衡延迟和吞吐量等目标指标。通过新的程序链范式,FlashRT指导通用编码智能体进行多阶段转换过程,包括将参考转换为中间表示以捕获数据依赖和持久状态范围,通过顺序解释器验证此IR,并进行静态分析以识别候选转换。然后,智能体在测量门控优化循环下迭代实现、验证和基准测试每个候选,以产生跨越不同硬件预算的有效部署。在各种应用中,FlashRT将参考实现转换为高效部署,在NVIDIA B200 GPU上延迟降低高达约70倍,吞吐量提高2.8倍。在AMD MI355X GPU上,FlashRT在匹配峰值延迟降低的同时将峰值吞吐量提高到3.6倍,表明在专家优化不太成熟的平台上,智能体驱动的优化更具可扩展性。实际上,对于Qwen3 - Omni文本到音频推理,与AMD MI355X上的专家vLLM - Omni实现相比,FlashRT将响应延迟降低了65%。

英文摘要

Real-time multimodal applications, including voice agents and interactive video generation, compose heterogeneous models into pipelines whose efficient deployment requires application-specific decisions about placement, streaming, and intra-model parallelism. Existing serving systems and auto-parallelism compilers commit to limited transformations and fixed workload assumptions, so achieving high performance on a new application requires hand-crafting an efficient implementation. We present FlashRT, an agent harness that guides coding agents to lift simple developer-written reference implementations into optimized multi-GPU deployments that flexibly weigh target metrics like latency and throughput. Using a new chain-of-program paradigm, FlashRT directs a generic coding agent through a multi-pass transformation process where an agent transforms the reference into an intermediate representation (IR) to capture data dependencies and persistent-state scopes, validates this IR via a sequential interpreter, and performs static analyses to identify candidate transformations. Then, the agent iteratively implements, verifies, and benchmarks each candidate under a measurement-gated optimization loop to produce effective deployments that span different hardware budgets. Across various applications, including video world models and multimodal LLMs, FlashRT converts reference implementations into highly efficient deployments, delivering up to ~70x latency reduction and 2.8x throughput improvement on NVIDIA B200 GPUs. On AMD MI355X GPUs, FlashRT matches the peak latency reduction while increasing peak throughput improvement to 3.6x, demonstrating that agent-driven optimization can be more scalable on platforms with less mature expert optimization. In fact, for Qwen3-Omni text-to-audio inference, FlashRT reduces response latency by 65% compared to the expert vLLM-Omni implementation on AMD MI355X.

URL PDF HTML 收藏
2607.18154 2026-07-21 cs.RO 新提交

World Translation: Minimizing Sim-to-Real Gap with Backward Dynamics Extraction and Unpaired Domain Translation

世界翻译:通过反向动力学提取和非配对域翻译最小化模拟与现实之间的差距

Xinchen Yao, Leixin Chang, Hua Chen

机构 * Zhejiang University(浙江大学) LimX Dynamics(LimX动力学公司)

AI总结 研究模拟与现实差距问题,提出“世界翻译”方法,利用模拟器和学习动力学互补优势,反向提取动力学信息并跨域转换,实验表明该方法能更准确建模,在特定情况下优势明显,还证实可改进策略转移。

Comments 8 pages, 8 figures

详情
AI中文摘要

在现实世界中部署经过模拟训练的机器人策略时,模拟与现实之间的差距仍然是一个基本挑战。实到模拟方法从现实角度缩小了这一差距,从现实数据中学习过渡动力学以构建更逼真的数字世界,其中学习到的动力学模型是主要实例。然而,此类方法面临部分可观测性问题,相同观测可能因不可观测因素而导致不同过渡。现有方法假定这些因素可从观测历史中恢复,但在观测历史无信息时可能失败。为解决此限制,我们提出了“世界翻译”,利用模拟器和学习到的动力学的互补优势。我们从观测到的过渡中反向提取不可观测的动力学信息,然后将此特征作为非配对域翻译问题在模拟与现实之间进行转换,以在转移域风格的同时保留动力学内容。在人形机器人、四足机器人和操纵器平台上的实验表明,我们的方法比基线实现了更准确的动力学建模,在无法从观测历史中恢复不可观测因素时收益最大。在Go2四足机器人上的实际机器人部署证实了改进的策略转移。

英文摘要

The gap between simulation and reality remains a fundamental challenge in deploying simulation-trained robotic policies in the real world. Real-to-sim methods narrow this gap from the real side, learning transition dynamics from real data to build a more realistic digital world. Learned dynamics models are their dominant instance. Such methods, however, face a partial observability problem: the same observation may branch to different transitions due to unobservable factors. Existing methods assume these factors can be recovered from observation history. However, this may fail whenever observation history is uninformative, such as a sudden contact event with no prior warning. To address this limitation, we propose \textit{World Translation}, which exploits a complementary strength of simulators and learned dynamics. Simulators are deterministic but physically imperfect, while learned models are accurate but underdetermined under partial observability. Rather than predicting transitions forward from history, we extract the unobservable dynamics information backward from an observed transition, then translate this feature across simulation and reality as an unpaired domain-translation problem that preserves dynamics content while transferring domain style. Experiments across humanoid, quadruped, and manipulator platforms show that our method achieves more accurate dynamics modeling than baselines, with the largest gains when unobservable factors cannot be recovered from observation history. Real-robot deployment on Go2 quadruped confirms improved policy transfer.

URL PDF HTML 收藏
2607.18147 2026-07-21 eess.SY cs.AI cs.SY 新提交

LLMs and Agentic AI Systems for Smart Grids: A Tutorial on Architectures and Applications

用于智能电网的大语言模型和智能AI系统:架构与应用教程

Daniela Rojas, Abdulwahab Albassam, Aidan G. Leung, Jett Ngo, Ryan Luo, Peter R. Quawas, Junpyung Kim, Kangkai Liang, Mansi Nanavati, Jonathan Mai, Meng-Chi Tsai, Yun-Tong Tsai, Yize Chen, Yuanyuan Shi

机构 * Department of Electrical and Computer Engineering, University of California San Diego(加州大学圣迭戈分校电气与计算机工程系) Department of Electrical and Computer Engineering, University of Alberta(阿尔伯塔大学电气与计算机工程系)

AI总结 研究智能电网中LLMs和智能AI系统,提出基于求解器的设计原则,通过提示策略等构建模块及四个案例研究实例化该原则,比较不同方案,还提出四组评估框架,明确了各部分分工。

Comments 28 pages, 11 figures, 6 tables; plus supplementary material. Review/tutorial article

详情
AI中文摘要

大语言模型(LLMs)和智能AI系统已从自然语言任务发展到在技术领域中使用外部工具进行规划、检索和行动。在智能电网中,近期工作将智能方案应用于预测、优化和控制,在语言接口后包装可信求解器并编排多步工作流程。文献中缺乏设计和评估此类系统的统一方法。本文提出基于求解器的设计原则:仅当数值结果源自可信工具并通过显式验证时才报告。回顾了用于电力系统的LLM和智能AI系统的构建模块:提示策略和智能架构。通过四个案例研究实例化该原则,比较了仅使用LLM的基线与其基于求解器的对应方案。提出了一个涵盖任务效用、基于求解器的正确性、忠实性和安全失败以及成本和延迟的四组评估框架。

英文摘要

Large language models (LLMs) and agentic AI systems have evolved from natural language tasks to using external tools to plan, retrieve, and act in technical domains. In smart grids, recent work applies agentic schemes to forecasting, optimization, and control, wrapping trusted solvers behind language interfaces and orchestrating multi-step workflows. The literature lacks a unified approach to designing and evaluating such systems. LLMs can produce numerically plausible yet physically infeasible outputs, evaluation protocols vary across tasks, and the boundary between what the model should and should not compute is implicit. This paper presents a solver-grounded design principle: a numerical result is reported only when it originates from a trusted tool and passes explicit verification. We review the building blocks of LLM and agentic AI systems for power systems: prompting strategies and agentic architectures. We instantiate the principle in four case studies: wind power forecasting, EV charging scheduling, power flow analysis, and contingency diagnosis, each comparing an LLM-only baseline against its solver-grounded counterpart on identical data and metrics. EVAgent reproduces the CVXPY optimum while reducing LLM-only unmet energy by 7.5-9.5x, and GridDebugAgent repairs 17/39 contingency cases while reducing total violations by 52.3%. We propose a four-group evaluation framework spanning task utility, solver-grounded correctness, faithfulness and safe failure, and cost and latency. A consistent division of labor emerges: the agentic system reliably orchestrates, retrieves, and explains, while trusted tools compute and a verification gate decides what is reported.

URL PDF HTML 收藏
2607.18142 2026-07-21 cs.CV cs.AI cs.CL cs.MA 新提交

O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning

O-VAD:通过以对象为中心的跟踪和推理进行工业视频异常检测

Mei Yuan, Qi Long, Qifeng Wu, Zhenyang Li, Yizhou Zhao, Lei Wang, Yang Liu, Min Xu

机构 * Carnegie Mellon University(卡内基梅隆大学) University of Alabama at Birmingham(阿拉巴马大学伯明翰分校) Griffith University(格里菲斯大学)

AI总结 针对工业视频异常检测,现有基于VLM的方法在工业场景中性能不佳的问题,提出无训练的智能框架O-VAD,通过跟踪对象时空动态和推理状态轨迹来检测异常,在多数据集实验中优于多种方法且能提供可解释报告。

Comments Accepted to ECCV 2026

详情
AI中文摘要

工业视频异常检测(IVAD)旨在识别工业过程中的异常对象和事件,对现代制造和质量控制系统至关重要。现有的基于视觉语言模型(VLM)的异常推理方法在一般领域能检测开放式异常,但在工业场景中性能下降。为此引入无训练的智能框架O-VAD,无需特定领域知识,强调对象状态演变。它跟踪检测对象的时空动态和潜在变换,通过对象时间状态轨迹推理识别异常对象。该方法克服了依赖正常片段再训练或注入领域知识的现有方法的局限性。在三个IVAD数据集上的大量实验表明,O-VAD优于前沿VLM、智能框架和在各自数据集上微调的传统VAD方法,还能提供异常过程和类型的可解释报告。

英文摘要

Industrial Video Anomaly Detection (IVAD) aims to identify anomalous objects and events in an industrial process, which is crucial for modern manufacturing and quality control systems. Existing VLM-based anomaly reasoning methods are capable of detecting open-ended anomalies in general domains. However, their performance declines in industrial settings characterized by intricate object transformations, strict physics, and procedural constraints. To tackle the complexity of such interaction-intensive detection, we introduce a training-free agentic framework for anomaly detection free of domain-specific knowledge, emphasizing object state evolution like humans inspectors. It is designed to track spatial-temporal dynamics and underlying transformations of detected objects over time, and then reason over the object-wise temporal state trajectories to identify abnormal objects in grounded frames. Our method overcomes limitations of prior approaches that rely on retraining on normal clips or injecting domain knowledge as context for test-time inference. Extensive experiments on three IVAD datasets demonstrate that our method outperforms frontier VLMs, agentic frameworks, and traditional VAD methods fine-tuned on the respective datasets, while providing interpretable reports over anomaly processes and types.

URL PDF HTML 收藏
2607.18114 2026-07-21 cs.CL cs.AI cs.LG 新提交

How Does Alignment Tuning Shape Representations of Sycophancy and Related Cue-Induced Biases in LLMs?

对齐调整如何塑造大语言模型中谄媚及相关线索诱导偏差的表征?

Prakhar Gupta, Terry Jingchen Zhang, Florent Draye, Bernhard Schölkopf, Zhijing Jin

机构 * University of Michigan(密歇根大学) Jinesis Lab, University of Toronto & Vector Institute(多伦多大学Jinesis实验室和向量研究所) Max-Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所) ELLIS Institute Tübingen(图宾根ELLIS研究所)

AI总结 研究大语言模型中谄媚及相关线索诱导偏差的位置,通过从隐藏状态提取偏差方向并经探测等三种方法三角测量,发现易感性由对齐调整而非预训练导致,还能适度去偏,偏差是对齐调整安装的不同因果活性方向。

详情
AI中文摘要

现代大语言模型极易受到输入提示中简单无形变化的影响:一个随意的暗示、一个标注错误的少样本示例或一个虚假的先前助手回复往往会使原本正确的答案翻转。我们研究这种涵盖谄媚及相关线索诱导偏差的易感性在模型内部的位置。跨越五个模型家族和七种BCT偏差类型,我们从隐藏状态中提取每个偏差方向,并通过三种方法进行三角测量:探测、留一数据集转移和因果干预。这种易感性很大程度上是由对齐调整而非预训练造成的:预训练的基础模型几乎不受这些偏差影响,其激活除了问题内容外没有特定线索信号。在对齐模型中,每个偏差成为一个单一连贯方向,我们既能解码又能引导,在每个测试家族中恢复无偏差答案。偏差在表征上保持 distinct,交叉偏差纠缠是特定于模型而非偏差类别的属性,行为相似的偏差也占据不同方向。相同的干预也是一种适度的去偏工具,在保留所有指令家族中大多数正确答案的同时,恢复了相当一部分偏差诱导的错误。因此,线索诱导偏差最好理解为对齐调整所安装的一组不同的、具有因果活性的方向,而不是大语言模型中的单一缺陷。

英文摘要

Modern LLMs are alarmingly susceptible to surprisingly simple immaterial changes of input prompts: a casual hint, an incorrectly labeled few-shot example, or a fake prior assistant turn often flips an originally correct answer. We study where this susceptibility, spanning sycophancy and related cue-induced biases, lives inside the model. Across five model families and seven BCT bias types, we extract a per-bias direction from hidden states and triangulate it through three measures: probing, leave-one-dataset-out transfer, and causal intervention. The susceptibility is largely installed by alignment tuning rather than pretraining: pretrained base models barely cave to these biases, and their activations carry no cue-specific signal beyond question content. Within aligned models, each bias becomes a single coherent direction that we can both decode and steer along, recovering the unbiased answer across every family we test. The biases stay representationally distinct, however: cross-bias entanglement is model-specific rather than a property of the bias category, and even behaviorally similar biases occupy different directions. The same intervention also serves as a modest debiasing tool, recovering a meaningful share of bias-induced errors while preserving most correct answers across all instruct families. Cue-induced bias is therefore best understood not as a single flaw in LLMs but as a family of distinct, causally active directions that alignment tuning installs.

URL PDF HTML 收藏
2607.18110 2026-07-21 cs.LG cs.CL 新提交

LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks

大语言模型作为教练:不可验证任务的体验式学习

Tianzhu Ye, Li Dong, Guanheng Chen, He Zhu, Xun Wu, Shaohan Huang, Furu Wei

机构 * Microsoft Research(微软研究院) Tsinghua University(清华大学) Peking University(北京大学)

AI总结 研究不可验证任务,提出体验式学习(EL),将LLM反馈模型从评判转为教练,通过提炼体验知识提供密集监督,在开放式任务上表现优于基于规则的RL,泛化性好且减轻奖励作弊。

详情
AI中文摘要

在开放式任务上的强化学习(RL)将基于大语言模型(LLM)的基于规则的评估压缩为标量奖励,丢弃了丰富的文本反馈,并将具有不同质量配置文件的响应混为一谈。我们提出了体验式学习(EL),它将反馈模型从作为评判的LLM重新用作作为教练的LLM。教练将其对每个策略响应的评估提炼为可转移的体验知识,该知识为教师模型提供条件,并通过策略上下文提炼被策略内化。与标量奖励相比,这个更高带宽的反馈通道提供了密集监督,并保留了高质量响应之间的细粒度偏好。在两个策略家族中,有来自策略本身或专有模型的反馈,EL在留出的和未见的开放式任务上始终优于基于规则的RL。值得注意的是,EL在训练分布之外具有更好的泛化能力,并减轻了奖励作弊。这些发现将体验知识确立为用于不可验证任务的训练后更丰富、更可泛化的学习信号。

英文摘要

Reinforcement learning (RL) on open-ended tasks compresses an LLM's rubric-based evaluation into a scalar reward, discarding rich textual feedback and conflating responses with distinct quality profiles. We propose Experiential Learning (EL), which repurposes the feedback model from an LLM-as-a-Judge into an LLM-as-a-Coach. The coach distills its assessment of each on-policy response into transferable experiential knowledge, which conditions a teacher model and is internalized by the policy through on-policy context distillation. Compared with scalar rewards, this higher-bandwidth feedback channel provides dense supervision and preserves fine-grained preferences among high-quality responses. Across two policy families, with feedback from the policy itself or a proprietary model, EL consistently outperforms rubric-based RL on held-out and unseen open-ended tasks. Notably, EL generalizes better beyond the training distribution, and mitigates reward hacking. These findings establish experiential knowledge as a richer and more generalizable learning signal for post-training on non-verifiable tasks.

URL PDF HTML 收藏
2607.18106 2026-07-21 cs.RO 新提交

Importance Sampling and PCA for Finding Failures in Commercial Autonomous Vehicles

用于发现商用自动驾驶车辆故障的重要性采样和主成分分析

Hailey Warner, Duncan Eddy, Shreya Parjan, Caroline Cahilly, Harrison Delecki, Matthias Kleinstauber, Chaitanya Shinde, Jerry Lopez, Mykel J. Kochenderfer

机构 * Department of Aeronautics and Astronautics, Stanford University(斯坦福大学航空航天系) Torc Robotics(Torc机器人公司)

AI总结 研究商用自动驾驶车辆故障发现问题,应用自适应压力测试和基于扩散的故障采样算法找到模拟碰撞,引入基于主成分分析的统计分析将故障分类并恢复噪声轨迹,为故障发现到系统诊断提供路径。

Comments IEEE ICVES 2026 (Submitted)

详情
AI中文摘要

目前,用于发现自主系统中罕见故障的方法几乎仅在具有简单学术驾驶堆栈的模拟中得到验证,尚不清楚它们是否能推广到商用系统中更强大的规划器。我们通过将两种罕见事件发现算法应用于商用自动驾驶卡车堆栈来填补这一空白。自适应压力测试(AST)使用强化学习搜索最可能导致模拟碰撞的噪声轨迹,而基于扩散的故障采样(DiFS)训练去噪扩散模型以采样各种故障。我们表明这两种算法都能发现传统蒙特卡罗模拟无法发现的合并和切入操作中的模拟碰撞。为使这些故障具有可操作性,我们引入基于主成分分析(PCA)的统计分析,将故障分类为常见模式并识别对结果影响最大的时间步长。我们对主成分进行聚类并反转PCA变换以恢复广义噪声轨迹,并表明这些轨迹在相同和相似场景中重现故障。这提供了一条从故障发现到感知级缺陷系统诊断的路径。

英文摘要

Methods for discovering rare failures in autonomous systems have so far been demonstrated almost exclusively in simulations with simple, academic driving stacks, leaving open whether they generalize to the more robust planners used in commercial systems. We address this gap by applying two rare-event discovery algorithms to a commercial autonomous trucking stack. Adaptive stress testing (AST) uses reinforcement learning to search for the most likely noise trajectories leading to a simulated collision, while diffusion-based failure sampling (DiFS) trains a denoising diffusion model to sample a diverse set of failures. We show that both algorithms find simulated collisions during merge and cut-in maneuvers where traditional Monte Carlo simulation does not. To make these failures actionable, we introduce a statistical analysis based on principal component analysis (PCA) that classifies failures into common modes and identifies the timesteps that most influence the outcome. We cluster the principal components and invert the PCA transform to recover generalized noise trajectories, and show that these trajectories reproduce failures in identical and similar scenarios. This provides a path from failure discovery to systematic diagnosis of perception-level flaws.

URL PDF HTML 收藏
2607.18100 2026-07-21 cs.AI 新提交

Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering

我们能否使大语言模型摆脱自我循环?通过激活引导实现细粒度推理控制

Sheldon Yu, Tong Yu, Xunyi Jiang, Rohan Surana, Gagan Mundada, Sungchul Kim, Lina Yao, Julian McAuley, Junda Wu

机构 * UC San Diego(加州大学圣地亚哥分校) Adobe Research(Adobe研究院) University of New South Wales(新南威尔士大学)

AI总结 研究大语言模型推理过程不可控问题,提出SOPHIA方法,通过将推理轨迹视为潜在状态序列,构建引导向量库,在推理时进行干预,可检测并防止自我循环,提升推理质量。

详情
AI中文摘要

扩展推理已成为前沿大语言模型(LLMs)的标准,但模型生成的轨迹在很大程度上仍无法控制。现有塑造模型推理方式的方法是基于提示的,在输入层面操作,无法对推理过程本身进行细粒度控制。相关工作分析并发现了大语言模型推理轨迹中的潜在转换动态。在此基础上,我们对这些状态进行统计表征,发现失败轨迹会陷入自我循环。为干预这些失败,我们提出了SOPHIA:通过隐藏状态干预和激活来引导推理过程。我们将每个推理轨迹视为潜在状态序列,分类前缀到潜在状态,记录步骤级转换,构建引导向量库。在推理时,控制器推断当前状态,给定目标状态检索相应向量,还能从转换结构中在线检测自我循环。实验表明,我们的方法能可靠干预自我循环失败,引导向量可推广到不同状态对,细粒度可控性带来更好的推理质量。

英文摘要

Extended reasoning has become standard for frontier Large Language Models (LLMs), yet the trajectories these models produce remain largely uncontrollable. Existing methods for shaping how a model reasons are prompt based approaches and operate at the input level, offering no fine-grained control over the reasoning process itself. Related work analyzes and discovers latent transition dynamics in the reasoning traces from Large Language Models. Building on this, we statistically characterize these states, and show that failure trajectories get stuck in self-loops, exhausting the token budget without progress toward the final answer. To intervene on these failures, We propose SOPHIA: Steering Of reasoning Processes via Hidden-state Intervention and Activations. We treat each reasoning trace as a sequence of latent states rather than an unstructured texts, and investigate whether inference time interventions can provide fine-grained control over the self-looping reasoning process. We classify every prefix to a latent state, record step level transitions, and use them to construct a bank of steering vectors indexed by state pairs. At inference time, a controller infers the current state and, given a target state, retrieves the corresponding vector and can also detect self-loops online from the transition structure to prevent the model from sinking into a reasoning black hole. Through extensive experiments, our method reliably intervenes on self-loop failures, with steering vectors that generalize to different state pairs. End task accuracy and token efficiency indicate that fine-grained controllability results in better reasoning quality.

URL PDF HTML 收藏
2607.18091 2026-07-21 cs.CV cs.GR cs.LG 新提交

SciForma: Structure-Faithful Generation of Scientific Diagrams

SciForma:科学图表的结构忠实生成

Yuxuan Luo, Peng Zhang, Xinjie Zhang, Xun Guo, Zhouhui Lian, Yan Lu

机构 * Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机技术研究所) State Key Lab of CAD & CG, Zhejiang University(浙江大学CAD&CG国家重点实验室) Microsoft Research Asia(微软亚洲研究院)

AI总结 研究针对科学图表结构保真度问题,提出SciForma框架,分解图表质量为三个结构轴,用M-DPO优化,策划训练和评估数据,实现迭代编辑,使SciForma-9B超越开源基线和GPT-Image-1.5,提升科学图表生成的结构保真度。

Comments 30 pages, 21 figures

详情
AI中文摘要

结构保真度对于科学方法图表至关重要。为传达研究逻辑,此类图表必须如实呈现组件、方向关系和文本注释。由于单个错误(如箭头反向或方程式不可读)会使整个图表无效,结构保真度本质上是联合性的。当前开源模型不满足此标准。监督微调(SFT)学习合理布局但无法可靠确保结构正确性,基于标量奖励的训练后处理会掩盖失败的结构维度。为解决此问题,我们引入SciForma框架。它将图表质量分解为组件、箭头和文本三个结构轴,基于此策划了用于结构化训练的SciFormaData-700K和用于逻辑验证评估的SciFormaBench-2K。我们开发了多维联合偏好优化(M-DPO),在训练后跨所有轴强制同时正确,并将梯度自适应路由到最不足的维度。推理时可进行迭代编辑以纠正残留错误。这使得SciForma-9B在SciFormaBench-2K和AIBench上超越所有开源基线和GPT-Image-1.5,使开放科学图表生成接近专有级别的结构保真度。

英文摘要

Structural fidelity is essential to scientific methodology diagrams. To communicate research logic, these diagrams must faithfully render components, directional relations, and textual annotations. Since a single error, such as a reversed arrow or an unreadable equation, can invalidate the entire figure, structural fidelity is inherently conjunctive: correctness on one axis cannot compensate for failure on another. Current open-source models fail to satisfy this criterion. Supervised fine-tuning (SFT) learns plausible layouts but cannot reliably ensure structural correctness, while scalar reward-based post-training obscures which structural dimension has failed. To address this, we introduce SciForma, a framework for the structure faithful generation of scientific methodology diagrams. Specifically, SciForma decomposes diagram quality into three structural axes: Component, Arrow, and Text, guided by a structural inventory. Built on this foundation, we curate SciFormaData-700K for structured training and SciFormaBench-2K for logic-verified evaluation. To close the gap left by SFT, we develop Multi-Dimensional Conjunctive Preference Optimization (M-DPO), which enforces simultaneous correctness across all axes and adaptively routes gradients to the most deficient dimension in post-training. The same structural inventory also enables iterative editing at inference time to correct residual errors. This combination allows SciForma-9B to exceed all open-source baselines and GPT-Image-1.5 on both SciFormaBench-2K and AIBench, bringing open scientific diagram generation close to proprietary-level structural fidelity. Our code and data will be available at: https://github.com/microsoft/SciForma.

URL PDF HTML 收藏
2607.18088 2026-07-21 cs.LG cs.CV 新提交

The Label Complexity of Class-Conditional Coverage under Distribution Shift

分布偏移下类条件覆盖的标签复杂性

Weijia Han, Lisha Qu

机构 * University of Washington(华盛顿大学)

AI总结 研究分布偏移下类条件覆盖的标签复杂性,指出无标签方法难以兼顾有效性和效率,精确了恢复每类有效性的成本,通过骨架动作识别等案例研究表明相关现象在多模态基准上存在。

Comments 16 pages main text, 22-page supplement

详情
AI中文摘要

许多识别系统的标准评估中存在分布偏移,因为基准在训练和测试分割中设置了不相交的条件。在这种偏移下,分割共形预测使边际覆盖率接近标称水平,而每类覆盖率却悄然失效。我们刻画了恢复每类有效性的成本。首先,存在一个不可能的情况:一旦偏移同时作用于协变量和标签,目标类条件得分律就无法从源标签和未标记的目标样本中识别出来,所以没有无标签方法能同时实现有效且高效的每类覆盖率。其次,我们精确了成本:仅每类有效性只需每类少量目标标签,而要同时实现有效性和每类效率所需的标签数量随着效率容差的平方反比和类数的对数增长,且有匹配的上下界。第三,在评估的预测驱动推理家族中,即使在无界未标记目标池上最有利地使用分类器自己的伪标签,在覆盖率崩溃时效率最多提高一个小常数因子。骨架动作识别是我们的真实数据案例研究。仅使用源标签进行每类校准可在偏移保持边际覆盖率时恢复大部分每类差距,且在边际覆盖率本身崩溃时停止起作用。三种严重程度不断增加的真实偏移追踪了这个边界,并且在自然图像损坏基准上也出现了同样的崩溃和恢复,超越了任何单一模态。

英文摘要

Standard evaluation of many recognition systems contains distribution shift by construction, since benchmarks place disjoint conditions in the training and test splits. Under such a shift, split conformal prediction keeps marginal coverage near the nominal level while per-class coverage fails silently: on a real cross-subject skeleton benchmark, marginal coverage stays near ninety percent, the worst action class is covered about seventy percent of the time, and ten of the sixty classes fall below eighty percent coverage. We characterize the cost of restoring per-class validity. First, an impossibility: once the shift acts jointly on the covariates and the labels, the target class-conditional score law is unidentified from source labels and an unlabeled target sample, so no label-free method attains per-class coverage that is at once valid and efficient. Second, we make the cost precise: per-class validity alone needs only a handful of target labels per class, while the label count necessary and sufficient for validity together with per-class efficiency grows as the inverse square of the efficiency tolerance and the logarithm of the number of classes, with matching upper and lower bounds. Third, within the evaluated prediction-powered inference family, even the most favorable use of the classifier's own pseudo-labels on an unbounded unlabeled target pool improves efficiency by at most a small constant factor where coverage collapses. Skeleton action recognition is our real-data case study. A per-class calibration using source labels alone recovers a substantial share of the per-class gap while the shift preserves marginal coverage, and stops helping exactly when marginal coverage itself breaks. Three real shifts of increasing severity trace this boundary, and the same collapse and recovery appears on a natural-image corruption benchmark, beyond any single modality.

URL PDF HTML 收藏
2607.18084 2026-07-21 cs.AI cs.CL cs.LG 新提交

WorldCupArena: Fine-Grained Evaluation of Language Models and Deep-Research Agents on Football Forecasting

世界杯竞技场:语言模型和深度研究代理在足球预测上的细粒度评估

Zhaokai Wang, Tianlin Gui, Jiayuan Rao, Shangzhe Di, Yihong Tang, Dingli Liang

机构 * Shanghai Jiao Tong University(上海交通大学) McGill University(麦吉尔大学) University College London(伦敦大学学院)

AI总结 介绍世界杯竞技场这一语言模型和深度研究代理的动态基准,用于足球预测。模型赛前接收证据或自行搜索信息进行多项预测,赛后与实际结果对比。通过多指标评估104场比赛和13个系统,展示不同模型表现及与基线对比情况,且新赛程可添加用于评估未来模型。

详情
AI中文摘要

开球前预测足球比赛需要的不仅仅是了解过去的结果:模型必须利用不断变化的信息并在答案可用之前做出明确预测。我们提出了世界杯竞技场,这是一个用于语言模型和深度研究代理的动态基准。2026年国际足联世界杯是其首次评估,相同流程可用于未来联赛和杯赛。每场比赛前,模型要么接收通用证据包,要么自行搜索信息,预测比赛结果、比分、可能的球员和事件、比赛统计数据以及比赛结果。比赛结束后,将这些预测与记录结果进行比较。我们报告了结果准确率、精确比分准确率、当预测比分接近但不准确时给予一定分数的比分线分数,以及其他预测任务的分数。在104场比赛和13个系统中,结果准确率相似的模型在详细预测上差异更明显。与博彩市场和球迷基线相比,最佳系统在结果和精确比分准确率上仅略有提高,但在比分线分数上有更明显的提高。新赛程开始时可添加,使该基准能够评估未来模型而无需使用已知结果。代码、提示、预测和评估脚本在该https网址开源。

英文摘要

Predicting a football match before kickoff requires more than knowing past results: a model must use changing information and make a clear prediction before the answer is available. We present WorldCupArena, a dynamic benchmark for language models and deep-research agents. The 2026 FIFA World Cup is its first evaluation, and the same process can be reused for future leagues and cups. Before each match, a model either receives a common evidence package or searches for information itself. It predicts the result and score, likely players and events, match statistics, and the outcome of the competition. After the match, these predictions are compared with the recorded result. We report result accuracy, exact-score accuracy, and a scoreline score that gives some credit when a predicted score is close but not exact, together with scores for the other prediction tasks. Across 104 matches and 13 systems, models with similar result accuracy differ more clearly on detailed predictions. Compared with betting-market and human-fan baselines, the best system shows only small gains in result and exact-score accuracy, but a clearer gain in Scoreline. New schedules can be added as they begin, allowing the benchmark to evaluate future models without using outcomes that are already known. Code, prompts, predictions, and evaluation scripts are open sourced at https://github.com/wzk1015/WorldCupArena.

URL PDF HTML 收藏
2607.18082 2026-07-21 cs.LG cs.AI 新提交

Enhancing Rubric-based RL via Self-Distillation

通过自蒸馏增强基于评分标准的强化学习

Mingxuan Xia, Yuhang Yang, Chao Ye, Shuai Zhu, Shenzhi Yang, Guangcheng Zhu, Yuhang Zhang, Cheng Peng, Haobo Wang, Siqing Wang

机构 * Zhejiang University(浙江大学) ByteDance(字节跳动)

AI总结 研究基于评分标准的强化学习中探索有限问题,提出标准蒸馏策略优化(CriPO),通过策略内自蒸馏同时解决未探索标准和被抑制标准问题,在医学和科学基准测试中表现出色,减少优化步骤并提升性能。

详情
AI中文摘要

基于评分标准的强化学习在改进大语言模型的开放式任务中展现出潜力。其公认的局限是探索有限,未探索标准(UC)未获优化信号。近期方法通过在展开过程中纳入评分标准信息解决此问题,但引入了训练与推理不匹配。此外,这些方法忽视了被抑制标准(SC)这一失败模式。我们的分析表明SC很普遍。为同时解决UC和SC且不引入训练推理不匹配,我们提出标准蒸馏策略优化(CriPO),通过策略内自蒸馏增强基于评分标准的强化学习。在医学和科学基准测试中,CriPO持续优于基于评分标准的强化学习,以约少两倍的优化步骤实现更强的最终性能。

英文摘要

Rubric-based RL has recently shown promise in improving LLMs on open-ended tasks. A widely recognized limitation of rubric-based RL is limited exploration: criteria that no rollout manages to satisfy (Unexplored Criteria, UC) receive no optimization signal. Recent methods address this by incorporating rubric information as external guidance during rollout, yet they introduce a train-inference mismatch: the policy is optimized on rollouts produced under external guidance while this guidance is absent at inference time, causing error accumulation through autoregressive decoding. Moreover, these exploration-focused approaches overlook a fundamentally different failure mode that we term Suppressed Criteria (SC) -- criteria that are satisfied by some rollouts yet whose learning signals are lost during optimization because scalar reward aggregation assigns them non-positive aggregate advantages. Our analysis reveals that SC are remarkably prevalent: over 57% of samples exhibit this failure mode throughout training, with an average of 1.8 SC per sample. To simultaneously address both UC and SC without introducing training-inference mismatch, we propose Criterion-Distilled Policy Optimization (CriPO), which enhances rubric-based RL via on-policy self-distillation. For UC, CriPO constructs a criterion-injection self-teacher and computes a localized forward-KL loss to inject missing behaviors into the policy. For SC, CriPO employs a counterfactual self-teacher to locate criterion-relevant tokens in negative-advantage rollouts and flips their token-level advantages to positive values, preserving useful patterns that would otherwise be suppressed. Experiments on medicine and science benchmarks demonstrate that CriPO consistently outperforms rubric-based RL, achieving stronger final performance with approximately $2\times$ fewer optimization steps.

URL PDF HTML 收藏
2607.18072 2026-07-21 cs.LG cs.AI 新提交

SGN: A Similarity-based Generative Network for Data Generation under Distribution Shift

SGN:一种用于分布偏移下数据生成的基于相似度的生成网络

Jiaqi Zhu, Xincheng Chen, Yuncheng Wu, Zhaojing Luo, Beng Chin Ooi

机构 * National University of Singapore(新加坡国立大学) Renmin University of China(中国人民大学) Beijing Institute of Technology(北京理工大学) Zhejiang University(浙江大学)

AI总结 研究分布偏移下数据生成问题,提出基于相似度的生成网络SGN,在源数据训练后无需参数更新用于新目标域,通过学习潜在空间和利用目标域小代表性集,实现目标引导数据增强,实验验证其有效性。

详情
AI中文摘要

在源域上训练的生成模型生成的样本与偏移后的目标域往往匹配不佳,限制了其在目标域数据增强方面的有效性。虽然特定于目标的适应可以减少这种不匹配,但通常需要额外的优化和特定于域的参数。我们提出了一种基于相似度的生成网络(SGN),这是一个可重复使用的框架,在有标签的源数据上训练一次,无需参数更新即可应用于新的目标域。SGN学习由标签诱导的成对相似度构建的潜在空间,同时通过编码器-解码器架构保留重构信息。在生成时,对来自目标域的一个小的有标签代表性集进行编码,并在学习到的潜在空间中进行组合,使生成的样本在保持类一致性的同时继承目标特定特征。我们进一步分析了所提出的相似度结构的可实现性和维度要求。在图像和表格数据集上的实验证明了SGN在源到目标分布偏移下进行目标引导数据增强的有效性。

英文摘要

Generative models trained on a source domain often produce samples that are poorly aligned with shifted target domains, limiting their effectiveness for target-domain data augmentation. Although target-specific adaptation can reduce this mismatch, it typically requires additional optimization and domain-specific parameters. We propose a Similarity-based Generative Network (SGN), a reusable framework that is trained once on labeled source data and applied to new target domains without parameter updates. SGN learns a latent space structured by label-induced pairwise similarities while preserving reconstructive information through an encoder-decoder architecture. At generation time, a small labeled representative set from the target domain is encoded and combined in the learned latent space, allowing the generated samples to inherit target-specific characteristics while maintaining class consistency. We further analyze the realizability and dimensionality requirements of the proposed similarity structure. Experiments on image and tabular datasets demonstrate the effectiveness of SGN for target-guided data augmentation under source-to-target distribution shifts.

URL PDF HTML 收藏
2607.18069 2026-07-21 cs.AR cs.LG 新提交

Hardware Mechanisms to Dynamically Throttle AI Performance

动态限制人工智能性能的硬件机制

Haiyue Ma, Lauren Malek, Joseph Forzani, David Wentzlaff

机构 * Princeton University(普林斯顿大学) Princeton University Electrical(普林斯顿大学电子与计算机工程)

AI总结 研究在人工智能模型集成到关键系统时缺乏意图控制的问题,提出用微架构旋钮动态控制硬件资源限制AI性能,评估候选旋钮并构建机制,展示其高性能敏感度等优势及多旋钮组合效果。

详情
AI中文摘要

随着功能更强大的人工智能模型越来越多地集成到关键计算机系统中,缺乏对人工智能意图的控制促使人们建立安全机制。现有软件保护措施仅施加行为约束,可能被足够智能的模型绕过。虽然硬件级安全强制被视为至关重要的最后一道防线,但除了对未经授权访问的政策规定或粗略的全芯片关闭外,很少有机制被提出。本文引入了一组微架构旋钮,可在运行时动态控制可用硬件资源以限制人工智能性能。评估了跨越GPU内存子系统在容量、带宽、延迟和频率维度的候选旋钮,确定了四个有力候选者:L2大小、L2延迟、L2带宽和共享内存端口访问速率。为最小化新逻辑和额外设计成本,用成熟的微架构原语构建了所有四种机制。结果表明这些旋钮具有高性能敏感度、可忽略的实现成本、动态节流后快速稳定以及对芯片其余部分的最小附带影响。此外,多旋钮分析揭示了能放大性能下降的旋钮组合,可实现更广泛的性能目标。

英文摘要

As more capable AI models are increasingly integrated into critical computer systems, the lack of control over AI intent motivates safety mechanisms. Existing software safeguards impose only behavioral constraints that can potentially be bypassed by sufficiently intelligent models. While hardware-level safety enforcement has been recognized as an essential last line of defense, few mechanisms have been proposed beyond policy regulations on unauthorized accesses or coarse full-chip shutdown. What is missing is a fine-grained, dynamic intervention mechanism at the architecture level. In this paper, we introduce a set of microarchitecture knobs which dynamically control the available hardware resources to limit AI performance at runtime. We evaluate candidate knobs spanning the GPU memory subsystem, across capacity, bandwidth, latency and frequency dimensions, and narrow down to four strong candidates: L2 size, L2 latency, L2 bandwidth, and shared memory port access rate. To minimize new logic and extra design cost, we build all four mechanisms from well-established microarchitectural primitives: cache way masking, credit-based rate limiting, latency insertion, and bank arbitration. We show that these knobs achieve high performance sensitivity (up to 80% performance cut at 1/8 resource availability), negligible implementation cost (<~10K flip flops), fast stabilization after dynamic throttling (5-80K cycles), and minimal collateral impact on the rest of the chip. Further, multi-knob analysis reveals combinations of knobs that amplify the performance degradation beyond the effect of each knob individually, which enables a broader range of performance targets.

URL PDF HTML 收藏
2607.18062 2026-07-21 cs.RO cs.CV 新提交

UniETP: Unifying Environments for Generalizable Embodied Task Planning

UniETP:统一用于通用具身任务规划的环境

Peiran Xu, Jiaqi Zheng, Ziyou Wang, Yadong Mu

机构 * Peking University(北京大学)

AI总结 针对具身任务规划中模拟器和数据集孤立的问题,提出UniETP统一接口,整合四个常用模拟器,兼具标准化与多样性,构建新数据集,通过实验评估模型具身规划能力并分析瓶颈。

Comments We are actively working on releasing the codes and data

详情
AI中文摘要

本文聚焦具身任务规划问题,即智能体需在交互环境中执行一系列原子动作以完成用户指定任务。此前虽有多种模拟器和数据集,但相互孤立。为此提出UniETP,它整合了四个常用模拟器。其特点是标准化与多样性兼具,一方面规范观察和动作空间并构建评估系统,另一方面提升任务多样性和复杂性,自动构建新数据集。通过实验评估模型具身规划能力并分析瓶颈。

英文摘要

This paper focuses on the problem of Embodied Task Planning, where an agent is required to execute a sequence of atomic actions within an interactive environment to complete a user-specified task. Though a variety of simulators and datasets have previously been built for this task, these efforts are largely isolated, with each using its own observation format, action type, and task domain. This fragmentation complicates comprehensive model evaluation and hinders the scalability of training data. As an effort towards generalizable embodied planning, we propose UniETP, a unified interface integrating four commonly-used simulators (AI2-THOR, VirtualHome, Habitat, BEHAVIOR). UniETP is characterized by both standardization and diversity. On one hand, it formalizes all the simulators into a consistent observation and action space, and builds an evaluation system to support complicated task goal. On the other hand, it enhances task diversity and complexity across dimensions like task logic, instance grounding, and instruction understanding, constructing a new dataset with varied levels of difficulty in an automatic manner. Extensive experiments on the proposed benchmark are conducted to evaluate the embodied planning capabilities of recent models and analyze the performance bottlenecks. Codes and data will be available at https://github.com/woyut/UniETP .

URL PDF HTML 收藏