arXivDaily arXiv每日学术速递 周一至周五更新
重置
全部学科分类 2070
2606.11203 2026-06-11 cs.CL cs.LG 新提交

LatticeBridge: Rare-Event Sequential Inference for Faithful Structured Sequence Synthesis

LatticeBridge: 用于忠实结构化序列合成的罕见事件序列推理

Faruk Alpay, Bugra Kilictas

发表机构 * Bahcesehir University(巴切塞希尔大学)

AI总结 针对结构化序列生成中约束满足的罕见事件问题,提出LatticeBridge方法,结合前缀语言模型、实例编译表面自动机和扭曲序列蒙特卡洛解码器,在多个基准上显著提升锚点满足率和覆盖率。

Comments 19 pages. Code and benchmark files available at https://github.com/farukalpay/latticebridge

详情
AI中文摘要

结构化序列生成通常要求模型在单个输出中满足多个输入派生约束。标准解码方法可能赋予流畅延续高概率,而对同时实现所有必需锚点的延续赋予低概率。我们将此机制视为罕见事件序列推理问题。LatticeBridge 结合了紧凑前缀语言模型、实例编译表面自动机以及带有重采样、多级分裂和源自实例提供短语的源支持提议项的扭曲序列蒙特卡洛 (SMC) 解码器。约束表示从每个输入实例编译而来,不依赖人工整理的词汇类别。在涵盖 CommonGen、E2E NLG 和 WikiBio 的 2,610 个可达到验证任务上,粒子解码器在共享提议模型下,相比贪心、波束过滤和 best-of-k 祖先基线,提高了精确锚点满足率和平均锚点覆盖率。由于仅精确锚点满足不能排除不支持的属性替换,评估同时报告了所需锚点覆盖率、源覆盖率、源入侵诊断、重叠度、运行时间和粒子统计量。该基准在固定提议模型下刻画了忠实度-重叠度-延迟前沿。

英文摘要

Structured sequence generation often requires a model to satisfy several input-derived constraints in a single output. Standard decoding methods may assign high probability to fluent continuations while placing low mass on continuations that realize all required anchors jointly. We study this regime as a rare-event sequential inference problem. LatticeBridge combines a compact prefix language model, instance-compiled surface automata, and a twisted sequential Monte Carlo (SMC) decoder with resampling, multilevel splitting, and a source-support proposal term derived from instance-provided phrases. The constraint representation is compiled from each input instance and does not rely on manually curated lexical classes. On 2,610 attainable validation tasks spanning CommonGen, E2E NLG, and WikiBio, the particle decoder improves exact anchor satisfaction and mean anchor coverage over greedy, beam-filtered, and best-of-k ancestral baselines under a shared proposal model. Since exact anchor satisfaction alone does not rule out unsupported attribute substitutions, the evaluation reports required-anchor coverage, source coverage, source-intrusion diagnostics, overlap, runtime, and particle statistics jointly. The benchmark characterizes the faithfulness-overlap-latency frontier under a fixed proposal model.

2606.11202 2026-06-11 cs.CL 新提交

One Jailbreak, Many Tongues: Learning Language-Insensitive Intention Representations for Multilingual Jailbreak Detection

一次越狱,多种语言:学习语言无关的意图表示用于多语言越狱检测

Shuyu Jiang, Kaiyu Xu, Xingshu Chen, Hao Ren, Rui Tang, Yi Zhang, Tianwei Zhang, Hongwei Li

发表机构 * School of Cyber Science and Engineering, Sichuan University(四川大学网络空间安全学院) School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院) School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院)

AI总结 针对多语言LLM安全漏洞,提出MLJailDe框架,通过多语言回译数据增强和相对距离约束,实现跨语言越狱检测,F1达98.5%。

详情
AI中文摘要

大型语言模型(LLMs)越来越多地部署在面向全球多语言用户的应用程序中,然而安全训练仍集中在主流语言上,并未与多语言能力同步发展,从而为越狱攻击创造了可利用的漏洞。当前的越狱防御主要是在主流语言中开发和评估的,其有效性受到对齐的多语言监督稀缺以及语言变异导致的表示分散的限制。为了解决这个问题,我们提出了MLJailDe,一个多语言越狱检测框架,旨在提高多语言鲁棒性和跨语言泛化能力。MLJailDe首先引入了一种多语言回译数据增强算法,构建了一个语义一致且功能有效的数据集,涵盖11种语言,包含2,232个良性样本和1,239个越狱样本。在此基础上,MLJailDe采用相对距离约束来减少跨语言表示分散,并鼓励具有相似意图的越狱提示在不同语言中形成一致的聚类,同时进一步使用不平衡感知的分类目标来缓解类别不平衡并学习更可靠的多语言决策边界。实验结果表明,MLJailDe在多种语言上优于最先进的基线,F1分数达到98.5%,并且在未见过的语言上平均F1分数达到97.1%,展示了强大的有效性和跨语言泛化能力。

英文摘要

Large language models (LLMs) are increasingly deployed in applications for global multilingual users, yet safety training remains concentrated in dominant languages and has not progressed in parallel with multilingual capability, creating exploitable gaps for jailbreak attacks. Current jailbreak defenses are largely developed and evaluated in dominant languages, and their effectiveness is limited by the scarcity of aligned multilingual supervision and representations dispersion caused by language variation. To address this issue, we propose MLJailDe, a multilingual jailbreak detection framework designed to improve both multilingual robustness and cross-lingual generalization. MLJailDe first introduces a multilingual back-translation data augmentation algorithm to construct a semantically consistent and functionally effective dataset spanning 11 languages, consisting of 2,232 benign and 1,239 jailbreak samples. On this basis, MLJailDe employs relative-distance constraints to reduce cross-lingual representation dispersion and encourage jailbreak prompts with similar intent to form consistent clusters across languages, while an imbalance-aware classification objective is further used to alleviate class imbalance and learn more reliable multilingual decision boundaries. Experimental results show that MLJailDe outperforms state-of-the-art baselines across multiple languages, achieving an F1 score of 98.5\%, and obtains an average F1 score of 97.1\% on unseen languages, demonstrating strong effectiveness and cross-lingual generalization.

2606.11201 2026-06-11 cs.LG cs.AI cs.CL 新提交

To Intervene or Not: Guiding Inference-time Alignment with Probabilistic Model Blending

干预还是不干预:通过概率模型混合指导推理时对齐

Jin Gan, Xin Li, Jun Luo

发表机构 * College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算机与数据科学学院)

AI总结 提出BlendIn框架,通过质量感知对齐和按可靠性加权混合模型知识,解决推理时对齐中指导有效性差异大的问题,在困难模型对上实现最高50%的性能提升。

Comments Accepted by ACL 2026

详情
AI中文摘要

LLM的广泛部署使得模型对齐成为必要,以确保新训练的模型能够安全有效地响应用户指令。在不同方法中,推理时对齐通常更便宜,因为它仅在输出生成期间进行干预(即提供指导)。现有提案从某些对齐模型中提取指导,但没有适当评估其可靠性。然而,我们的系统评估显示,指导有效性在不同模型间差异很大;由于无效指导会导致进一步混乱和更多干预,由此产生的过度干预通常表明性能较差。为了使干预更有效且更高效,我们引入了BlendIn,一个推理时对齐框架,从二元决策转向创建整合两个模型知识的混合分布。BlendIn通过执行质量感知对齐并根据可靠性按比例加权每个模型的贡献来稳定推理时对齐。与现有工作相比,它保留了有益的指导,同时降低了不可靠建议的权重。BlendIn为未对齐的指导提供了诊断信号和缓解策略,在困难模型对上实现了一致且高达50%的性能提升。我们的代码可在以下网址获取:this https URL。

英文摘要

The wide deployment of LLMs has made model alignment necessary to make newly trained models safely and effectively respond to user instructions. Among different methods, inference-time alignment is often cheaper as it intervenes (i.e., offers guidances) only during output generation. Existing proposals apply guidances extracted from certain aligned models without properly assessing their reliability. Nonetheless, our systematic evaluation reveals that guidance effectiveness varies drastically across models; since ineffective guidances lead to further confusion and thus further interventions, the resulting excessive interventions typically indicate poor performance. To make interventions more effective and thus more efficient, we introduce BlendIn, an inference-time alignment framework that shifts from binary decisions to creating hybrid distributions integrating both models' knowledge. BlendIn stabilizes inference-time alignment by performing quality-aware alignment and proportionally weighting each model's contribution based on reliability. Compared with existing works, it preserves beneficial guidance while downweighting unreliable suggestions. BlendIn provides both diagnostic signals and mitigation strategies for misaligned guidance, achieving consistent and up to 50% performance improvement on challenging model pairs. Our code is available at: https://github.com/DecayingSeart/BlendIn.

2606.11200 2026-06-11 cs.CL cs.CV 新提交

Detecting AI-Generated Content on Social Media with Multi-modal Language Models

使用多模态语言模型检测社交媒体上的AI生成内容

Chenyang Yang, Shen Yan, Yibo Yang, Litao Hu, Yuchen Liu, Yuan Zeng, Hanchao Yu, Yinan Zhu, Sumedha Singla, Brian Vanover, Huijun Qian, Zihao Wang, Fujun Liu, Aashu Singh, Jianyu Wang, Xuewen Zhang

发表机构 * Carnegie Mellon University(卡内基梅隆大学) Meta

AI总结 针对AI生成内容检测的泛化性差、单模态依赖和缺乏可解释性问题,提出基于多模态数据的紧凑视觉-语言模型,实现检测与解释,在公开基准和内部数据集上达到最优性能。

详情
AI中文摘要

生成式AI使得逼真的图像和视频得以创建,并越来越多地在社交媒体上传播,通常用于垃圾信息、错误信息、操纵和欺诈。现有的AI生成内容(AIGC)检测方法面临挑战,包括对新一代模型的泛化能力差、依赖单一模态以及缺乏可解释的解释。我们提出了一个流程,通过持续整理多样化的多模态社交媒体数据并训练一个紧凑的视觉-语言模型用于检测和解释,来缓解这些问题。我们的模型在公开基准上达到了最先进的检测性能,并在多个平台的内部社交媒体数据集上展示了强大的检测和解释能力。我们将模型部署在社交媒体平台上用于帖子推荐,并观察到对用户参与度的积极下游影响,表明在动态、真实的社交媒体环境中进行有效的AIGC检测是可行的。

英文摘要

Generative AI has enabled the creation of photorealistic images and videos that are increasingly disseminated on social media, often used for spam, misinformation, manipulation, and fraud. Existing AI-generated content (AIGC) detection methods face challenges including poor generalization to new generation models, reliance on single modalities, and lack of interpretable explanations. We present our pipeline that mitigates these issues by continuously curating diverse multi-modal social media data and training a compact vision-language model for detection and explanation. Our model achieves state-of-the-art detection performance on public benchmarks and demonstrates robust detection and explanation capabilities on internal social media datasets across multiple platforms. We deployed our model for post recommendation on social media platforms and observed positive downstream impacts on user engagement, demonstrating that it is feasible to perform effective AIGC detection in dynamic, real-world social media environments.

2606.11198 2026-06-11 cs.CL cs.AI 新提交

The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content

结构注意力税:检索格式如何劫持上下文学习而与内容无关

Yuqi Zhang, Di Zhang

发表机构 * Xi’an Jiaotong-Liverpool University(西交利物浦大学)

AI总结 研究发现知识图谱三元组因其格式结构比自然语言吸引2-3倍注意力,压缩演示注意力达42%,并提出了分解注意力为语义与结构成分的框架及缓解策略。

Comments 10 pages, 5 figures

详情
AI中文摘要

检索增强生成(RAG)系统注入外部知识以改进大语言模型输出,然而注入内容的格式——区别于其语义相关性——可以独立地扭曲模型的注意力分布。我们识别并形式化了一种称为结构注意力税的现象:知识图谱(KG)三元组,由于其关系分隔符和重复的槽位模式,每个token捕获的注意力是语义等价的自然语言文本的2-3倍($\hat{o}$(KG) ≈ 0.70 对比 $\hat{o}$(中性) ≈ 0.25),将演示注意力压缩高达42%——无论三元组是相关还是噪声。我们开发了一个形式化框架,将注意力分数分解为语义和结构成分(公式2),推导了一个压缩界(命题1),将token级别的格式偏差与演示注意力损失联系起来,并表明结构项控制着注意力被转移多少,而语义项控制着这是有益还是有害。这种解耦揭示了改进检索增强ICL的两个正交轴:优化检索质量(语义轴)和减少格式驱动的注意力捕获(结构轴)。实验上,在两个模型家族(Mistral-7B, LLaMA-3-8B)和三个QA基准上,我们观察到源任务对齐占主导地位:任务匹配的BM25检索在HotpotQA上达到58-62%,而ConceptNet为25-27%,超过30个百分点的差距远远超过所有门控策略(≤2个百分点)。我们从该框架推导出五种结构感知缓解策略,从零成本提示修改到训练时正则化;格式展平(S3)通过来自口头化三元组控制的准确性和注意力级证据得到验证,而结构分散(S1)产生了混合结果,揭示了格式级别干预的挑战。

英文摘要

Retrieval-augmented generation (RAG) systems inject external knowledge to improve LLM outputs, yet the format of injected content -- distinct from its semantic relevance -- can independently distort the model's attention distribution. We identify and formalise a phenomenon we term the structural attention tax: knowledge graph (KG) triples, due to their relational delimiters and repeated slot patterns, capture 2-3x more attention per token than semantically equivalent natural-language text ($\hat{o}$(KG) $\approx$ 0.70 vs. $\hat{o}$(neutral) $\approx$ 0.25), compressing demonstration attention by up to 42% -- regardless of whether the triples are relevant or noise. We develop a formal framework decomposing attention scores into semantic and structural components (Eq. 2), derive a compression bound (Proposition 1) connecting token-level format bias to demonstration attention loss, and show that the structural term governs how much attention is diverted while the semantic term governs whether this helps or hurts. This decoupling reveals two orthogonal axes for improving retrieval-augmented ICL: optimising retrieval quality (semantic axis) and reducing format-driven attention capture (structural axis). Empirically, across two model families (Mistral-7B, LLaMA-3-8B) and three QA benchmarks, we observe that source-task alignment dominates: task-matched BM25 retrieval achieves 58-62% on HotpotQA vs. ConceptNet's 25-27%, a >30 pp gap that dwarfs all gating strategies ($\leq$2 pp). We derive five structure-aware mitigation strategies from the framework, ranging from zero-cost prompt modifications to training-time regularisation; format flattening (S3) is validated by both accuracy and attention-level evidence from a verbalized-triple control, while structural dispersal (S1) yields mixed results that illuminate the challenges of format-level intervention.

2606.11196 2026-06-11 cs.CL cs.AI cs.CR cs.LG 新提交

PoQ-Judge: A Multi-Architecture Evaluation Framework for Cost-Aware Proof-of-Quality in Decentralized LLM Inference

PoQ-Judge:去中心化LLM推理中成本感知的证明质量的多架构评估框架

Arther Tian, Alex Ding, Frank Chen, Simon Wu, Aaron Chan

发表机构 * DGrid AI

AI总结 提出PoQ-Judge框架,训练专用裁判模型对查询-输出对进行无参考评分,研究三种架构,最佳模型在Pearson相关性上达到0.747,级联评估降低72.7%成本。

详情
AI中文摘要

去中心化LLM推理网络需要轻量级、无参考的质量评估用于证明质量(PoQ)。我们提出PoQ-Judge,一个训练专用裁判模型对查询-输出对进行评分而无真实参考的框架。我们研究了三种架构在质量-成本权衡中的表现:TextCNN裁判、MiniLM交叉编码器和DeBERTa裁判。通过在UltraFeedback和GPT标记的领域内数据上进行两阶段训练,最佳模型在保留测试集上与真实代理的Pearson相关性达到0.747,优于先前工作中基于参考的评估器。作为复合评分中的无参考组件,它实现了0.645的Pearson相关性,匹配最佳单一基于参考的评估器,同时消除了对参考答案的需求。我们还表明,在线校准将语义质量识别为主导维度,级联评估将成本降低72.7%,仅带来适度的质量损失。结果在问答任务上比摘要任务强得多,表明代理质量是主要剩余限制。

英文摘要

Decentralized LLM inference networks need lightweight, reference-free quality evaluation for Proof of Quality (PoQ). We present PoQ-Judge, a framework that trains dedicated judge models to score query-output pairs without ground-truth references. We study three architectures across the quality-cost tradeoff: a TextCNN judge, a MiniLM cross-encoder, and a DeBERTa judge. Using two-stage training on UltraFeedback plus GPT-labeled in-domain data, the best model reaches 0.747 Pearson correlation with the ground-truth proxy on a held-out test set, outperforming reference-based evaluators from prior work. As a reference-free component in composite scoring, it achieves 0.645 Pearson correlation, matching the best single reference-based evaluator while removing the need for reference answers. We also show that online calibration identifies semantic quality as the dominant dimension and that cascade evaluation reduces cost by 72.7 percent with only modest quality loss. Results are much stronger on QA than summarization, pointing to proxy quality as the main remaining limitation.

2606.11192 2026-06-11 cs.LG math.OC 新提交

Restless bandits with imperfect binary feedback: PCL-indexability analysis and computation

具有不完美二元反馈的 restless bandits: PCL-indexability 分析与计算

José Niño-Mora

发表机构 * Universidad Carlos III de Madrid(马德里卡洛斯三世大学)

AI总结 针对具有二元隐状态和不完美二元反馈的 restless bandits,提出基于部分守恒律(PCL)的分析与计算框架,通过验证定理、确定性骨架和组合词方法建立可索引性并计算 Whittle 指数,实验表明 MP 指数策略优于基准策略。

Comments 59 pages, 12 figures, submitted 27/3/2026

详情
AI中文摘要

我们研究具有二元隐状态和不完美二元反馈的 restless bandits,受具有感知错误的机会频谱接入启发。对于相关的信念状态模型,我们开发了一个基于部分守恒律(PCL)的分析与计算框架,用于建立可索引性和评估 Whittle 指数,该框架建立在实状态折扣 restless bandits 的验证定理之上。该框架通过相关的确定性骨架、更新分解和组合词分析随机动力学。它在几个阈值区域中为折扣奖励和资源度量提供了易处理的表达式,从而能够在那里完全验证 PCL 可索引性条件。对于本文中未实现完整分析验证的剩余区域,我们推导了用于计算相关边际度量和边际生产率(MP)指数的有效数值方案,当这些条件成立时,MP 指数等于 Whittle 指数。广泛的计算实验提供了强有力的证据,表明这些条件也在该区域中成立,跨越广泛的参数范围,且没有先前工作中施加的严格参数限制。实验进一步表明,MP 指数策略通常优于标准基准策略,且往往有显著优势。

英文摘要

We study restless bandits with binary latent states and imperfect binary feedback, motivated by opportunistic spectrum access with sensing errors. For the associated belief-state model, we develop a partial conservation laws (PCL)-based analytical and computational framework for establishing indexability and evaluating the Whittle index, building on a verification theorem for real-state discounted restless bandits. The framework analyzes the stochastic dynamics via an associated deterministic skeleton, renewal decompositions, and combinatorics on words. It yields tractable expressions for discounted reward and resource metrics in several threshold regimes, enabling full verification of the PCL-indexability conditions there. For the remaining regime, where a complete analytic verification is not achieved in this paper, we derive efficient numerical schemes for computing the relevant marginal metrics and the marginal productivity (MP) index, which equals the Whittle index when those conditions hold. Extensive computational experiments provide strong evidence that these conditions also hold in that regime across broad parameter ranges and without the stringent parameter restrictions imposed in prior work. The experiments further show that theMP index policy typically outperforms standard benchmark policies, often by a substantial margin.

2606.07537 2026-06-11 cs.CL cs.AI cs.LG 交叉投稿

From Architecture to Output: Structural Origins of Hallucination in Large Language Models and the Amplifying Role of Data

从架构到输出:大语言模型中幻觉的结构性起源及数据的放大作用

Md. Rejaul Korim Sadi, Toufiqur Rahman Tasin, Golam Mostofa Naeem

发表机构 * University of Science and Technology of China(中国科学技术大学)

AI总结 本文分析大语言模型幻觉的结构性根源,指出自注意力、最大似然估计训练目标和自回归解码三个架构决策构成复合失效系统,并揭示数据病理如何放大这些脆弱性。

Comments 11 pages, 7 figures, 15 references

详情
AI中文摘要

大语言模型会产生幻觉——生成流畅、自信但事实错误的输出——这种一致性跨越代际和规模。现有分类法按输出类型对幻觉进行分类,区分内在与外在失败以及忠实性与事实性偏差。这些框架在描述上严谨,但未能识别产生特定实例的内部机制。本文将幻觉分析为三个架构决策的结构性后果,这些决策共同构成一个复合失效系统。自注意力的共现学习用统计邻近性替代语义含义,导致实体混淆、事实错误归因和语义漂移。最大似然估计训练目标在无事实约束下优化下一个词元概率,奖励统计上合理的输出,无论其真值如何。自回归解码在暴露偏差下的永久从左到右承诺确保单个错误词元级联向前传递整个输出序列而无法修正。数据集病理——长尾缺陷、训练偏差和合成污染——放大了这些脆弱性,但并非独立导致它们。我们做出三项贡献。首先,我们将每个机制映射到Alansari和Luqman分类法中的特定输出类别,将内在幻觉定位于自注意力,外在幻觉定位于MLE,逻辑不一致定位于自回归解码。其次,我们表明每个常被引用的数据集病理利用这些机制之一,而非独立产生幻觉。第三,我们识别出仅基于输出类型分类的诊断局限性,并将其与推理层缓解方法进行对比。

英文摘要

Large language models hallucinate--producing fluent, confident, factually wrong outputs--with a consistency that persists across generations and scales. Existing taxonomies classify hallucination by output type, distinguishing intrinsic from extrinsic failures and faithfulness from factuality divergence. These frameworks are descriptively rigorous but do not identify which internal mechanism produced a given instance. This paper analyses hallucination as a structural consequence of three architectural decisions that together form a compound failure system. Self-attention's co-occurrence learning substitutes statistical proximity for semantic meaning and produces entity confusion, fact misattribution, and semantic drift. The maximum likelihood estimation training objective optimises next-token probability without factual constraint, rewarding statistically plausible outputs regardless of their truth value. Autoregressive decoding's permanent left-to-right commitment under exposure bias ensures that a single wrong token cascades forward through the entire output sequence without revision. Dataset pathologies--long-tail deficiencies, training bias, and synthetic pollution--amplify these vulnerabilities but do not independently cause them. We make three contributions. First, we map each mechanism to a specific output category in the Alansari and Luqman taxonomy, locating intrinsic hallucination in self-attention, extrinsic hallucination in MLE, and logical inconsistency in autoregressive decoding. Second, we show that each commonly cited dataset pathology exploits one of these mechanisms rather than originating hallucination independently. Third, we identify the diagnostic limitation of output-type-only classification and contrast it with inference-layer mitigation approaches.

2605.04893 2026-06-11 cs.LG cs.CL stat.ML 版本更新

Self-Attention as Transport: Limits of Symmetric Spectral Diagnostics

自注意力作为传输:对称谱诊断的极限

Dominik Dahlem, Diego Maniloff, Mac Misiura

发表机构 * Red Hat AI(红帽人工智能)

AI总结 研究语言模型注意力路由的两种失效形状(过度集中或过度分散),证明对称谱诊断对方向不敏感,并揭示因果注意力中传输容量的理论下限,提出基于容量和方向的双轴诊断方法。

Comments 48 pages, 6 figures, 7 tables; 81-page online supplement (proofs, additional experiments, dataset statistics) as an ancillary file

详情
AI中文摘要

当语言模型处理幻觉响应时,其注意力路由往往以两种形状之一失效:过度集中在狭窄的位置集合上,或者分散得如此广泛以至于相关性被稀释,而失效的形状携带诊断信号。我们研究这些形状作为诊断特征,从在基准标记响应的\emph{强制评分}下计算的注意力矩阵中得出,而不是在实时生成期间。一类广泛使用的谱方法分析度归一化注意力算子的对称分量,该算子控制传输\emph{容量};我们证明该算子的每个转置不变谱诊断在结构上是\emph{方向盲的}(它无法区分算子与其转置,因此无法检测信息流方向),并且盲定理的逆定理将任何Lipschitz诊断的转置敏感性限制为不对称系数$G$。将其与规范因果架构的闭式二分-Cheeger景观配对,我们证明均匀因果注意力满足一个与$n$无关的下界$\phi \ge 1/5$,而窗口注意力以$O(w/n)$穿透下界;失效模式在形状上不同,而不仅仅在数值上不同。这个下界是一个理想化架构的基准,而不是经验吸引子:穿透它的真实注意力头的比例本身就是一个架构特征。由此产生的双轴诊断($\phi$表示容量,$G$表示方向)产生一个可证伪的极性预测:瓶颈主导和分散主导的基准应表现出相反的极性。在长度控制评估下,传输特征在测试的仅解码器、仅编码器和编码器-解码器模型中保持可解释的信号(0.62-0.84 LC-AUROC),极性在HaluEval和MedHallu之间如预测般反转。

英文摘要

When a language model processes a hallucinated response, its attention routing tends to fail in one of two shapes: over-concentrating on a narrow set of positions, or spreading so diffusely that relevance is diluted, and the shape of the failure carries diagnostic signal. We study these shapes as a diagnostic characterization, computed from attention matrices under \emph{forced scoring} of benchmark-labeled responses rather than during live generation. A widely used family of spectral methods analyzes the symmetric component of the degree-normalized attention operator, which governs transport \emph{capacity}; we prove that every transpose-invariant spectral diagnostic of this operator is structurally \emph{orientation-blind} (it cannot distinguish an operator from its transpose, and therefore cannot detect information-flow direction), with a converse to the blindness theorem bounding any Lipschitz diagnostic's transpose sensitivity by the asymmetry coefficient $G$. Pairing this with a closed-form bipartite-Cheeger landscape for canonical causal architectures, we show that uniform causal attention satisfies an $n$-independent floor $ϕ\ge 1/5$, while window attention pierces the floor as $O(w/n)$; failure modes are shape-different, not just value-different. This floor is an idealized-architecture benchmark, not an empirical attractor: the fraction of real attention heads that pierce it is itself an architectural signature. The resulting two-axis diagnostic ($ϕ$ for capacity, $G$ for direction) yields a falsifiable polarity prediction: bottleneck- and diffuse-dominated benchmarks should exhibit opposite polarity. Under length-controlled evaluation, transport features retain interpretable signal (0.62-0.84 LC-AUROC) across the tested decoder-only, encoder-only, and encoder-decoder models, with polarity reversing as predicted between HaluEval and MedHallu.

2605.04853 2026-06-11 cs.LG 版本更新

Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equations

非线性色散方程的混合迭代神经低正则积分器

Zhangyong Liang, Huanhuan Gao

发表机构 * National Center for Applied Mathematics, Tianjin University(天津大学应用数学中心) School of Mechanical and Aerospace Engineering, Jilin University(吉林大学机械与 aerospace 工程学院)

AI总结 提出HIN-LRI混合框架,用轻量神经网络学习并校正经典低正则积分器的结构截断误差,通过显式时间步缩放保证稳定性,在粗糙数据色散方程上提升精度并保持泛化能力。

详情
AI中文摘要

我们提出HIN-LRI,一种混合框架,通过训练一个神经算子来校正经典数值求解器的结构截断误差,从而增强该求解器。基础低正则积分器为非线性色散偏微分方程提供一致的一阶近似,而一个在低维潜在流形上运行的轻量神经网络学习解析方法无法闭合的残差缺陷。神经校正上的显式时间步缩放确保其Lipschitz贡献为$\mathcal{O}(\tau)$,从而产生一个在步长上一致有界且与空间分辨率无关的Gronwall稳定性因子。该网络通过求解器在环的目标进行端到端训练,该目标展开完整迭代并在Bourgain型范数中惩罚轨迹误差,使学习与多步求解器动态对齐,而非孤立的单步目标。在给定假设下,全局误差满足$C(\varepsilon_{net}+\delta)\\,\tau^\gamma\ln(1/\tau)$,其中$\varepsilon_{net}$衡量网络逼近质量,$\delta$衡量训练不足。在三个具有粗糙数据的色散基准上的实验表明,HIN-LRI在精度上优于解析积分器、分裂方法和神经PDE替代模型,具有稳定的空间细化、有效的分布外迁移和适度的在线开销。

英文摘要

We propose HIN-LRI, a hybrid framework that augments a classical numerical solver with a neural operator trained to correct the solver's structured truncation error. A base low-regularity integrator provides a consistent first-order approximation to nonlinear dispersive PDEs, while a lightweight neural network, operating on a low-dimensional latent manifold, learns the residual defect that analytical methods cannot close. An explicit time-step scaling on the neural correction ensures that its Lipschitz contribution remains $\mathcal{O}(τ)$, yielding a Gronwall stability factor bounded uniformly in the step size and independent of the spatial resolution. The network is trained end-to-end through a solver-in-the-loop objective that unrolls the full iteration and penalises trajectory error in a Bourgain-type norm, aligning learning with multi-step solver dynamics rather than isolated one-step targets. Under stated assumptions, the global error satisfies $C(\varepsilon_{net}+δ)\,τ^γ\ln(1/τ)$, where $\varepsilon_{net}$ measures the network approximation quality and $δ$ the training shortfall. Experiments on three dispersive benchmarks with rough data show that HIN-LRI improves accuracy over analytical integrators, splitting methods, and neural PDE surrogates, with stable spatial refinement, effective out-of-distribution transfer, and modest online overhead.

2605.04221 2026-06-11 cs.CL cs.AI 版本更新

Self-Prompting Small Language Models for Privacy-Sensitive Clinical Information Extraction

面向隐私敏感的临床信息抽取的自提示小型语言模型

Yao-Shun Chuang, Tushti Mody, Uday Pratap Singh, Shirindokht Shiraz, Chun-Teh Lee, Ryan Brandon, Muhammad F Walji, Xiaoqian Jiang, Bunmi Tokede

发表机构 * McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston(德克萨斯大学健康科学中心休斯顿分校麦克威廉斯生物医学信息学学院) School of Public Health, The University of Texas Health Science Center at Houston(德克萨斯大学健康科学中心休斯顿分校公共卫生学院) School of Dentistry, The University of Texas Health Science Center at Houston(德克萨斯大学健康科学中心休斯顿分校牙科学院) Willamette Dental and Skourtes Institute(威廉特牙科与斯库尔特斯研究所)

AI总结 针对牙科病历中非结构化、领域特定且隐私敏感的命名实体识别挑战,提出一种本地可部署的自提示框架,通过多提示集成推理和基于QLoRA的微调及直接偏好优化,使小型语言模型在Qwen2.5-14B-Instruct上达到微宏F1分数0.864/0.837。

详情
AI中文摘要

从牙科病程记录中进行临床命名实体识别具有挑战性,因为文档高度非结构化、领域特定且通常涉及隐私敏感信息。我们开发了一个本地可部署的框架,使小型语言模型能够自行生成、验证、完善和评估实体特定提示,以从牙科记录中提取多个临床实体。利用1,200份标注记录,我们通过多提示集成推理评估了候选开放权重模型,并进一步使用基于QLoRA的监督微调和直接偏好优化对选定模型进行调整。模型性能差异显著,凸显了需要针对特定任务进行评估而非依赖通用基准。Qwen2.5-14B-Instruct取得了最强的基线性能。经过DPO后,Qwen2.5-14B-Instruct和Llama-3.1-8B-Instruct分别达到了0.864/0.837和0.806/0.797的微/宏F1分数。这些发现表明,自动提示优化结合轻量级基于偏好的后训练可以支持使用本地部署的小型语言模型进行可扩展的临床信息抽取。

英文摘要

Clinical named entity recognition from dental progress notes is challenging because documentation is highly unstructured, domain-specific, and often privacy-sensitive. We developed a locally deployable framework that enables small language models to self-generate, verify, refine, and evaluate entity-specific prompts for extracting multiple clinical entities from dental notes. Using 1,200 annotated notes, we evaluated candidate open-weight models with multi-prompt ensemble inference and further adapted selected models using QLoRA-based supervised fine-tuning and direct preference optimization. Model performance varied substantially, highlighting the need for task-specific evaluation rather than reliance on generic benchmarks. Qwen2.5-14B-Instruct achieved the strongest baseline performance. After DPO, Qwen2.5-14B-Instruct and Llama-3.1-8B-Instruct achieved micro/macro F1 scores of 0.864/0.837 and 0.806/0.797, respectively. These findings suggest that automated prompt optimization combined with lightweight preference-based post-training can support scalable clinical information extraction using locally deployed small language models.

2605.02849 2026-06-11 cs.CV 版本更新

Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion

通过条件控制扩散实现超低比特率视频压缩的主动采样

Amirhosein Javadi, Shirin Saeedi Bidokhti, Tara Javidi

发表机构 * Department of Electrical and Computer Engineering, University of California San Diego(电子与计算机工程系,加州大学圣地亚哥分校) Department of Electrical and Systems Engineering, University of Pennsylvania(电子与系统工程系,宾夕法尼亚大学)

AI总结 提出ActDiff-VC框架,利用条件扩散模型和主动采样策略(自适应关键帧选择与预算感知稀疏轨迹选择),在超低比特率下实现高感知质量视频压缩。

Comments 21 pages, 11 figures, 3 tables

详情
AI中文摘要

扩散模型为超低比特率下的感知重建提供了强大的生成先验,但有效的视频压缩需要使用高度紧凑的条件信号来控制生成过程。在这项工作中,我们提出了ActDiff-VC,一种基于扩散的超低比特率视频压缩框架。我们的方法将视频划分为可变长度的片段,仅在需要时传输关键帧,并使用一组紧凑的跟踪点轨迹总结时间动态。基于这些稀疏信号,条件扩散解码器合成剩余帧,从而在严格的码率约束下实现感知上逼真的重建。为了支持这一设计,我们引入了两种机制:内容自适应关键帧选择和预算感知稀疏轨迹选择,它们共同为生成重建提供了紧凑而有效的条件。在UVG和MCL-JCV基准上的实验表明,在匹配NIQE时,ActDiff-VC实现了高达64.6%的码率降低,在可比码率下,KID改善高达64.6%,FID改善高达37.7%,并且在超低比特率下,相对于学习和基于扩散的基线,提供了有利的感知率失真权衡。

英文摘要

Diffusion models provide a powerful generative prior for perceptual reconstruction at ultra-low bitrates, but effective video compression requires controlling the generative process using highly compact conditioning signals. In this work, we present ActDiff-VC, a diffusion-based video compression framework for the ultra-low-bitrate regime. Our method partitions videos into variable-length segments, transmits keyframes only when needed, and summarizes temporal dynamics using a compact set of tracked point trajectories. Conditioned on these sparse signals, a conditional diffusion decoder synthesizes the remaining frames, enabling perceptually realistic reconstruction under severe rate constraints. To support this design, we introduce two mechanisms: content-adaptive keyframe selection and budget-aware sparse trajectory selection, which together enable compact yet effective conditioning for generative reconstruction. Experiments on the UVG and MCL-JCV benchmarks show that ActDiff-VC achieves up to 64.6\% bitrate reduction at matched NIQE, improves KID by up to 64.6\% and FID by up to 37.7\% at comparable bitrates against strong learned codecs, and delivers favorable perceptual rate--distortion trade-offs relative to learned and diffusion-based baselines in the ultra-low-bitrate regime.

2605.02411 2026-06-11 cs.AI cs.IR cs.LG cs.MA 版本更新

FitText: Evolving Agent Tool Ecologies via Memetic Retrieval

FitText: 通过模因检索演化智能体工具生态

Kyle Zheng, Han Zhang, Renliang Sun, Chenchen Ye, Wei Wang

发表机构 * UCLA(加州大学洛杉矶分校)

AI总结 针对用户任务描述与工具文档间的语义鸿沟,提出FitText框架,将检索嵌入推理循环,通过自然语言伪工具描述迭代优化和模因进化选择,显著提升工具检索性能。

详情
AI中文摘要

用户描述任务的方式与工具文档之间存在语义鸿沟。随着API生态扩展到数万个端点,仅凭初始查询的静态检索无法弥合这一鸿沟:智能体对其所需工具的理解在执行过程中不断演变,但其工具集却保持不变。我们指出,这种检索接口(而非规划)是端到端智能体性能的约束瓶颈,并引入FitText——一个无需训练的框架,通过将检索直接嵌入智能体的推理循环中,使其动态化。FitText将检索视为测试时假设的演化:智能体生成自然语言的伪工具描述(关于所需工具的可修正信念),利用检索反馈迭代优化,并通过随机生成探索多样化的替代方案。模因检索在候选描述上施加进化选择压力,并由避免冗余搜索的工具记忆引导。在ToolRet(三个领域)上,FitText的重构策略在所有基模型上相比静态查询检索将NDCG@5提升了2.7至10.6个点;在StableToolBench(16,464个API)上使用GPT-5.4-mini时,模因检索达到了84.3%的合并通过率,相比静态查询检索绝对提升了26.7个点。

英文摘要

A semantic gap separates how users describe tasks from how tools are documented. As API ecosystems scale to tens of thousands of endpoints, static retrieval from the initial query alone cannot bridge this gap: the agent's understanding of what it needs evolves during execution, but its tool set does not. We identify this retrieval interface, not planning, as the binding constraint on end-to-end agent performance, and introduce FitText, a training-free framework that makes retrieval dynamic by embedding it directly in the agent's reasoning loop. FitText treats retrieval as test-time evolution of hypotheses: the agent generates natural-language pseudo-tool descriptions (revisable beliefs about the tool it needs), refines them iteratively using retrieval feedback, and explores diverse alternatives through stochastic generation. Memetic Retrieval adds evolutionary selection pressure over candidate descriptions, guided by a tool memory that avoids redundant search. On ToolRet (three domains), FitText's reformulation strategies improve NDCG@5 by 2.7 to 10.6 points over static query retrieval across all base models; on StableToolBench (16,464 APIs) with GPT-5.4-mini, Memetic reaches an 84.3% pooled pass rate, a 26.7-point absolute gain over static query retrieval.

2606.11152 2026-06-11 cs.CV 版本更新

P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning

P3D-Bench:用于参数化3D生成与结构推理的多模态大语言模型基准

Yikang Yang, Zhanpeng Hu, Youtian Lin, Mengqi Zhou, Jingxi Xu, Feihu Zhang, Jiaheng Liu, Yao Yao

发表机构 * Nanjing University(南京大学) Envision

AI总结 提出P3D-Bench基准,通过参数化3D程序评估多模态大语言模型在几何精度、语义对齐和装配一致性上的表现,涵盖文本到3D、图像到3D和装配3D三类任务。

Comments Project page: https://spatiaos.github.io/projects/P3D-Bench

详情
AI中文摘要

多模态大语言模型能够编写代码生成复杂程序,并利用程序进行3D建模,这为基于其先验知识、世界知识和推理能力的3D生成开辟了新途径。然而,现有基准很少通过代码评估3D建模。这种建模不仅需要可运行代码:从文本或视觉规范出发,模型必须生成几何精确、语义对齐且装配一致的参数化3D程序。我们引入P3D-Bench,一个用于参数化3D生成的基准。与3D网格不同,参数化3D程序暴露了显式尺寸、构造操作和零件关系,揭示了模型是否恢复设计结构而不仅仅是外观。在统一协议下,P3D-Bench涵盖三个任务族(文本到3D、图像到3D和装配3D),并对每个输出进行可执行性、几何保真度、拓扑、文本约束、多视图语义对齐和零件级结构的评分。我们在400个文本案例、400个图像案例和203个带注释的装配体上评估了前沿多模态大语言模型和纯文本大语言模型,并以领域特定模型作为参考点。我们的广泛评估得出三个发现。首先,装配是最困难的设置,模型仍然无法将多个零件组合成连贯结构。其次,模型通常能恢复目标对象的整体形状和语义身份,但无法再现输入指定的精确参数化几何。第三,零件级建模在装配上仍然薄弱,模型既不能恢复每个零件的几何形状,也不能恢复正确的零件数量。这些结果使P3D-Bench成为评估参数化3D生成中精确参数化几何和零件级结构的基准。

英文摘要

Multimodal large language models can write code to produce complex programs as well as use programs to do 3D modeling, which opens up a new avenue for 3D generation powered by their priors, world knowledge and reasoning. Yet existing benchmarks rarely evaluate 3D modeling through code. Such modeling demands more than runnable code: from a text or visual specification, a model must generate a parametric 3D program that is geometrically precise, semantically aligned and assembly-consistent. We introduce P3D-Bench, a benchmark for parametric 3D generation. Unlike a 3D mesh, a parametric 3D program exposes explicit dimensions, construction operations and part relations, revealing whether a model recovers a design's structure, not just its appearance. Under a unified protocol, P3D-Bench covers three task families (Text-to-3D, Image-to-3D and Assembly-3D) and scores each output for executability, geometric fidelity, topology, text-grounded constraints, multiview semantic alignment and part-level structure. We evaluate frontier MLLMs and text-only LLMs on 400 text cases, 400 image cases and 203 annotated assemblies, with domain-specific models as reference points. Our extensive evaluation yields three findings. First, assemblies are the hardest setting, where models still fail to compose multiple parts into a coherent structure. Second, models can often recover the global shape and semantic identity of the target object, yet fail to reproduce the precise parametric geometry specified by the input. Third, part-level modeling remains weak on assemblies, where models recover neither the geometry of each part nor the right number of parts. These results position P3D-Bench as a benchmark for evaluating precise parametric geometry and part-level structure in parametric 3D generation.

2606.11074 2026-06-11 cs.CL cs.AI 版本更新

Modeling Complex Behaviors: Multi-Personality Composition and Dynamic Switching in Vision-Language Models

建模复杂行为:视觉语言模型中的多人格组合与动态切换

Peiqi Jia, Haonan Jia, Ziqi Miao, Linkang Du, Yuntao Wang, Zhou Su

发表机构 * Xi'an Jiaotong University(西安交通大学) Beihang University(北京航空航天大学)

AI总结 本研究在视觉语言模型中引入显式人格条件,建立包括单人格、多人格和人格切换的系统评估框架,发现人格提示可提升图像描述但损害精确推理任务,并观察到多特质组合与动态切换中的平衡与残留效应。

Comments 16 pages, 4 figures, 10 tables

详情
AI中文摘要

随着多模态大语言模型(MLLMs)在社交互动中的广泛部署,理解和控制其在复杂人格条件下的行为至关重要。本文引入显式人格条件,并建立了一个系统的评估框架,涵盖单人格诱导、多人格诱导和人格切换。实验表明,人格诱导能提升图像描述性能,但会损害需要精确推理的任务(如视觉问答)的性能。在多特质组合和动态切换过程中观察到平衡和残留效应,表明模型行为受到先前和当前人格约束的共同调节。现有的基于提示的人格诱导方法在多模态设置中表现出有限的迁移性。我们的工作揭示了MLLMs中人格建模的动态和复杂性质,并强调了针对人格诱导和评估的鲁棒、定制化方法的必要性。代码将在论文被接收后发布。

英文摘要

With the widespread deployment of Multimodal Large Language Models (MLLMs) in social interaction, understanding and controlling their behavior under complex personality conditions is essential. This paper introduces explicit personality conditioning and establishes a systematic evaluation framework encompassing single-personality induction, multi-personality induction, and personality switching. Experiments show that personality induction improves image captioning performance but can impair performance on tasks requiring precise reasoning, such as visual question answering (VQA). Balancing and residual effects are observed during multi-trait composition and dynamic switching, indicating that model behavior is co-modulated by both previous and current personality constraints. Existing prompt-based personality induction methods show limited transferability to multimodal settings. Our work reveals the dynamic and complex nature of personality modeling in MLLMs and underscores the need for robust, tailored methods for personality induction and evaluation. The code will be released when the paper is accepted.

2606.10968 2026-06-11 cs.LG cs.AI 版本更新

Beyond Uniform Token-Level Trust Region in LLM Reinforcement Learning

超越大语言模型强化学习中的统一令牌级信任区域

Renjie Mao, Xiangxin Zhou, Lvfang Tao, Yixin Ding, Yu Shi, Yongguang Lin, Yuheng Wu, Honglin Zhu, Qian Qiu, Wenxi Zhu

发表机构 * Tencent Hunyuan(腾讯混元)

AI总结 针对PPO风格信任区域在自回归生成中的位置无关问题,提出CPPO方法,通过位置加权阈值和累积前缀预算动态调整令牌级约束,提升训练稳定性和推理准确性。

Comments Project Page: https://hunyuan-cppo.github.io/

详情
AI中文摘要

具有可验证奖励的强化学习(RLVR)已成为提升大语言模型推理能力的标准方法。然而,现有的PPO风格信任区域机制通过在所有令牌上独立施加统一阈值,仍然是位置无关的。这种逐点处理方式在两个方面与自回归生成相冲突。首先,统一阈值忽略了自回归不对称性。早期阶段的偏差会产生累积的序列级漂移,导致静态阈值对早期发散约束不足,而对后期探索过度约束。其次,孤立地评估令牌级发散忽略了累积前缀漂移,无论条件历史已经偏离滚动策略多远,都给予相同的发散允许量。为解决这一局限性,我们提出了CPPO(累积前缀散度策略优化),这是一种令牌级掩码规则,通过两种耦合机制将更新与有限时域策略改进界对齐。首先,位置加权阈值对早期位置施加更严格的限制,因为这些位置的影响持续时间更长,同时放宽对后期令牌的约束。其次,累积前缀预算跟踪历史偏差,动态限制进一步的令牌级偏差,以防止沿前缀的复合错误。实验表明,CPPO在不同模型规模上增强了训练稳定性并显著提高了推理准确性。

英文摘要

Reinforcement learning with verifiable rewards (RLVR) has become standard for improving LLM reasoning. However, existing PPO-style trust-region mechanisms remain position-agnostic by enforcing uniform thresholds across all tokens independently. This pointwise treatment conflicts with autoregressive generation in two critical ways. First, uniform thresholds ignore autoregressive asymmetry. Early-stage deviations produce compounding sequence-level drift, causing static thresholds to under-regulate early divergence and excessively constrain late-stage exploration. Second, evaluating token-level divergence in isolation overlooks cumulative prefix drift, granting the same divergence allowance regardless of how far the conditioning history has already deviated from the rollout policy. To address this limitation, we propose CPPO (Cumulative Prefix-divergence Policy Optimization), a token-level masking rule that aligns updates with a finite-horizon policy-improvement bound via two coupled mechanisms. First, a position-weighted threshold imposes stricter limits at early positions whose effects persist longer, relaxing constraints for late-stage tokens. Second, a cumulative prefix budget tracks historical deviations, dynamically restricting further token-level deviation to prevent compounding errors along the prefix. Empirically, CPPO enhances training stability and significantly improves reasoning accuracy across various model scales.

2606.10820 2026-06-11 cs.LG cs.AI cs.CL 版本更新

K-Forcing: Joint Next-K-Token Decoding via Push-Forward Language Modeling

K-Forcing:通过前推语言建模进行联合下一K词解码

Zhiwei Tang, Yuanyu He, Yizheng Han, Wangbo Zhao, Jiasheng Tang, Fan Wang, Bohan Zhuang

发表机构 * DAMO Academy, Alibaba Group(阿里巴巴达摩院) Hupan Lab(湖畔实验室) Zhejiang University(浙江大学) The Hong Kong University of Science and Technology(香港科技大学)

AI总结 提出K-Forcing范式,通过前推映射将自回归模型蒸馏为单次前向传播生成多个未来词,实现2.4-3.5倍加速,质量损失小。

Comments Code: https://github.com/alibaba-damo-academy/K-Forcing

详情
AI中文摘要

自回归语言建模是文本生成的主导范式,但其逐词顺序解码使得推理受限于内存且效率低下。现有的加速方法(如推测解码和扩散语言模型)在特定条件下可提升速度,但并未直接解决高负载批量服务——这一对工业级部署最为关键的场景。我们提出K-Forcing,一种用于联合下一k词解码的前推语言建模范式。K-Forcing将现有自回归模型蒸馏为条件前推映射——该映射在单次前向传播中将独立均匀噪声变量转换为多个未来词的联合样本。该设计保留了固定长度输出,复用了自回归教师模型的主干,并与标准自回归服务基础设施兼容。我们通过渐进式自强迫蒸馏训练该映射,逐步扩展预测窗口,同时使学生模型紧密匹配自回归教师模型的序列分布。我们在LM1B和OpenWebText上使用标准因果Transformer主干评估K-Forcing。当激进配置为每次前向传播生成k=4个词时,K-Forcing在不同批量大小下实现约2.4-3.5倍加速,同时相对于自回归教师模型仅带来轻微的质量下降。随着推理在现代LLM的生命周期计算成本中占据主导地位,K-Forcing为在现实高负载部署下加速自回归生成提供了一条有前景的途径。

英文摘要

Autoregressive (AR) language modeling is the dominant paradigm for text generation, yet its sequential token-by-token decoding makes inference memory-bound and inefficient. Existing acceleration approaches, such as speculative decoding and diffusion language models, can yield speedups under certain conditions but do not directly address high-load batch serving--the scenario most critical for industrial-scale deployment. We introduce K-Forcing, a push-forward language modeling paradigm for joint next-k-token decoding. K-Forcing distills an existing AR model into a conditional push-forward mapping--one that transforms independent uniform noise variables into a joint sample of multiple future tokens in a single forward pass. This design preserves fixed-length outputs, reuses the AR teacher backbone, and remains compatible with standard AR serving infrastructure. We train this mapping via progressive self-forcing distillation, which gradually expands the prediction window while enabling the student to closely match the sequence distribution of the AR teacher. We evaluate K-Forcing on LM1B and OpenWebText using a standard causal Transformer backbone. When aggressively configured to generate k = 4 tokens per forward pass, K-Forcing delivers approximately 2.4-3.5x speedup across different batch sizes, while incurring modest quality degradation relative to its AR teacher. As inference increasingly dominates the lifetime compute cost of modern LLMs, K-Forcing offers a promising route toward accelerating AR generation under real-world high-load deployment.

2606.10804 2026-06-11 cs.CV 版本更新

SCAIL-2: Unifying Controlled Character Animation with End-to-end In-Context Conditioning

SCAIL-2:通过端到端上下文条件统一受控角色动画

Wenhao Yan, Fengjia Guo, Zhuoyi Yang, Jie Tang

发表机构 * Z.ai Tsinghua University(清华大学)

AI总结 提出SCAIL-2框架,通过端到端上下文条件统一受控角色动画,绕过中间表示直接利用驱动视频,并合成MotionPair-60K数据集,采用上下文掩码和模式RoPE实现统一,结合Bias-Aware DPO减少误差,显著优于现有方法。

详情
AI中文摘要

受控角色动画需要将运动从驱动序列转移到参考角色。先前的工作严重依赖中间表示,包括用于表示运动的姿态骨架或用于表示环境的掩码背景,这不可避免地导致信息损失。为了解决这个问题,我们提出了SCAIL-2,一个绕过这些中间表示并实现\textbf{端到端}角色动画的框架。通过将驱动视频直接连接到序列,模型可以从输入视频中获得所有所需的视觉信息。为了解决缺乏端到端数据的问题,我们通过解耦条件统一角色动画的子任务,然后策划一个流程来合成MotionPair-60K,一个包含角色动画异构任务的端到端运动转移数据集。为了实现统一,我们利用上下文掩码条件和模式特定的RoPE作为文本指令和原始视觉信息之外的软引导。为了解决详细区域的合成差异,我们提出了Bias-Aware DPO来构建偏好项目以减轻误差。大量实验表明,我们的方法在各种角色动画任务中显著优于现有的最先进方法。合成数据的一个大子集以及模型权重将在我们的项目页面发布:this https URL。

英文摘要

Controlled character animation requires transferring motion from a driving sequence to a reference character. Prior works heavily rely on intermediate representations, including pose skeletons to represent motion or masked background to represent environment, which inevitably leads to information loss. To address this, we present SCAIL-2, a framework that bypasses those intermediates and achieves \textbf{end-to-end} character animation. By directly concatenating driving videos to the sequence, the model can obtain all the required visual information from the input video. To address the lack of end-to-end data, we unify sub-tasks of character animation with decoupled conditions and then curate a pipeline to synthesize MotionPair-60K, an end-to-end motion transfer dataset containing heterogeneous tasks of character animation. To achieve the unification, we utilize in-context mask conditioning and mode-specific RoPE as soft guidance beyond textual instructions and raw visual information. To address synthetic discrepancy in detailed regions, we propose Bias-Aware DPO to construct preference items to mitigate the errors. Extensive experiments demonstrate that our method substantially outperforms existing state-of-the-art approaches in various character animation tasks. A large subset of synthetic data as well as model weights will be released at our project page: https://teal024.github.io/SCAIL-2/.

2606.10794 2026-06-11 cs.AI 版本更新

READER: Robust Evidence-based Authorship Decoding via Extracted Representations

READER: 基于提取表示的鲁棒证据作者身份解码

Jiaxu Liu, Sunnan Mu, Dong Huang, Liuyin Wang, Jing Shao, Jie Zhang

发表机构 * National University of Singapore(新加坡国立大学) Xidian University(西安电子科技大学) Tsinghua University(清华大学) Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)

AI总结 针对黑盒LLM来源识别问题,提出READER框架,通过冻结代理LLM读取隐藏作者证据,利用贝叶斯证据累积实现多查询归因,在Agent500数据集上显著优于基线方法。

详情
AI中文摘要

随着智能体应用越来越多地通过官方和第三方LLM API路由用户任务,来源成为一个操作性问题:哪个模型生成了给定的黑盒响应?我们研究动态黑盒LLM来源识别:从由查询变化、非预定义提示(而非固定输入集或基准套件)引发的生成中识别源LLM。这种设置很困难,因为提示语义主导文本,而模型特定的作者痕迹在表面层面是微弱且不一致的。我们引入READER(基于提取表示的鲁棒证据作者身份解码),一种轻量级来源框架,将冻结的代理LLM视为隐藏作者证据的读取器。READER将黑盒输出映射到代理激活空间,在时间上过滤每个响应中的令牌状态,并通过跨独立采样提示求和单响应对数后验证据来执行贝叶斯证据累积。这避免了提示特定表示的脆弱平均池化,同时保留了校准置信度所需的查询级证据。在Agent500(一个基于智能体风格提示构建的50目标数据集)上,READER从单个响应达到31.0%-42.4%的top-1准确率,从50个响应达到70.0%-84.0%的准确率,显著优于句子编码器指纹。跨九个代理读取器的扩展进一步表明,更强的LLM暴露更多线性可解码的作者身份结构,表明作者身份感知已经存在于冻结的LLM表示中,并且可以转化为可靠的多查询归因。

英文摘要

As agentic applications increasingly route user tasks through official and third-party LLM APIs, provenance becomes an operational question: which model generated a given black-box response? We study Dynamic Black-Box LLM Provenance: identifying the source LLM from generations elicited by query-varying, non-predefined prompts rather than a fixed input set or benchmark suite. This setting is difficult because prompt semantics dominate the text, while model-specific authorship traces are weak and inconsistent at the surface level. We introduce READER (Robust Evidence-based Authorship Decoding via Extracted Representations), a lightweight provenance framework that treats a frozen proxy LLM as a reader of hidden authorship evidence. READER maps black-box outputs into proxy activation space, temporally filters token states within each response, and performs Bayesian Evidence Accumulation by summing single-response log-posterior evidence across independently sampled prompts. This avoids fragile mean-pooling of prompt-specific representations while preserving the query-wise evidence needed for calibrated confidence. On Agent500, a 50-target dataset built from agent-style prompts, READER reaches $31.0$-$42.4\%$ top-1 accuracy from a single response and $70.0$-$84.0\%$ from 50 responses, substantially outperforming sentence-encoder fingerprints. Scaling across nine proxy readers further shows that stronger LLMs expose more linearly decodable authorship structure, suggesting that authorship perception is already present in frozen LLM representations and can be converted into reliable multi-query attribution.

2606.10775 2026-06-11 cs.CV 版本更新

Spatially Selective Self-Training for Unsupervised Building Change Detection

空间选择性自训练用于无监督建筑变化检测

Wafaa I. M. Hussin, Zhi Lu, Anas M. I. Mohammed, Xiang Zhou, Ratiba A. H. Abubaker, Zhenming Peng

发表机构 * School of Information and Communication Engineering, University of Electronic Science and Technology of China(电子科技大学信息与通信工程学院) Chengdu Yaguang Electronic Co., Ltd.(成都亚光电子股份有限公司) Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China(电子科技大学智能协同计算实验室) School of Civil Engineering, University of Khartoum(喀土穆大学土木工程学院) National Energy Research Center, Ministry of Higher Education and Scientific Research(高等教育部和科学研究部国家能源研究中心)

AI总结 提出SST-CD框架,利用空间选择性自训练和局部一致性准则,从无标签双时相遥感图像中学习建筑变化检测器,在三个数据集上超越现有无监督方法。

Comments Under Review

详情
AI中文摘要

无监督建筑变化检测旨在从未标记的双时相遥感图像中学习建筑变化掩膜。现有的无标签方法通常遵循差异到掩膜范式,直接使用时相差异、冻结的基础模型响应、基于提示的输出或后处理结果作为最终变化图。尽管这些策略提供了无标注线索,但它们并未学习任务特定的建筑变化检测器,并且仍然容易受到通用时相差异与建筑定义的结构变化之间的差距的影响。在实践中,这种差异通常是嘈杂且与任务无关的,因为外观变化、配准误差和非建筑修改可能产生强烈但误导性的响应。为了解决这个问题,我们提出了SST-CD,一种空间选择性自训练框架,将完全无标签的建筑变化检测重新表述为在嘈杂伪监督下的端到端检测器学习。SST-CD使用时相差异作为候选伪标签,并仅在空间可靠像素上训练检测器,其可靠性通过局部一致性准则估计,该准则从监督中过滤不一致区域。为了进一步稳定嘈杂的自训练,一个轻量级特征适配器重新校准双时相特征,而基于原型的解码器产生紧凑的变化和无变化表示。在LEVIR-CD、WHU-CD和DSIFN-CD上的实验表明,SST-CD分别达到了83.08%、91.69%和86.60%的F1分数,优于现有的无监督和无标签基线。代码将公开提供。

英文摘要

Unsupervised building change detection aims to learn building-change masks from unlabeled bi-temporal remote sensing images. Existing label-free methods often follow a discrepancy-to-mask paradigm, directly using temporal differences, frozen foundation-model responses, prompt-based outputs, or post-processing results as final change maps. Although these strategies provide annotation-free cues, they do not learn a task-specific building-change detector and remain vulnerable to the gap between generic temporal discrepancies and building-defined structural changes. In practice, such discrepancies are often noisy and task-irrelevant, as appearance shifts, registration errors, and non-building modifications can produce strong but misleading responses. To address this problem, we propose SST-CD, a spatially selective self-training framework that reformulates fully label-free building change detection as end-to-end detector learning under noisy pseudo supervision. SST-CD uses temporal discrepancies as candidate pseudo labels and trains the detector only on spatially reliable pixels, whose reliability is estimated by a local consistency criterion that filters inconsistent regions from supervision. To further stabilize noisy self-training, a lightweight feature adapter recalibrates bi-temporal features, while a prototype-based decoder produces compact change and no-change representations. Experiments on LEVIR-CD, WHU-CD, and DSIFN-CD show that SST-CD achieves F1 scores of 83.08%, 91.69%, and 86.60%, respectively, outperforming existing unsupervised and label-free baselines.

2606.10725 2026-06-11 cs.LG cs.CL 版本更新

Pre-AF 13: An Interpretable Atrial Fibrillation Risk Score Mined from Discharge Reports

Pre-AF 13:从出院报告中挖掘的可解释房颤风险评分

Olga Shakhmatova, Dmitrii Kriukov, Daniil Larionov, Nikita Khromov, Iaroslav Bespalov, Alexander Zolotarev, Kirill Grishchenkov, Ekaterina Ivanova, Miron Kuznetsov, Ilya Sochenkov, Elizaveta Panchenko, Artem Shelmanov, Dmitry V. Dylov

发表机构 * National Medical Research Center of Cardiology named after Academician E.I. Chazov(国家医学研究中心心脏病学以E.I. Chazov院士命名) Skolkovo Institute of Science and Technology (Skoltech)(斯科尔科沃科学技术研究所) Artificial Intelligence Research Institute (AIRI)(人工智能研究所) University of Mannheim(曼海姆大学) Russian Center for Scientific Information (RCSI)(俄罗斯科学信息中心) Institute of Cyber Intelligence Systems, National Research Nuclear University MEPhI(网络智能系统研究所,国家研究核大学MEPhI) M.V. Lomonosov Moscow State University(莫斯科国立罗蒙诺索夫大学) Institute for Information Transmission Problems of the Russian Academy of Sciences (Kharkevich Institute)(俄罗斯科学院信息传输问题研究所(Kharkevich研究所)) Ivannikov Institute for System Programming of the Russian Academy of Sciences (ISP RAS)(俄罗斯科学院伊万尼科夫系统编程研究所) Federal Research Center "Computer Science and Control" of the Russian Academy of Sciences (FRC CSC RAS)(俄罗斯科学院联邦研究中心“计算机科学与控制”) Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学)

AI总结 利用NLP从出院报告中提取特征,构建可解释ML模型预测心血管病患者房颤风险,Pre-AF 13模型优于现有临床评分。

Comments O. Shakhmatova and D. Kriukov contributed equally (co-first authors). E. Panchenko, A. Shelmanov, and D. V. Dylov are co-senior authors. Correspondence to: Olga Shakhmatova <olga.shahmatova [at] gmail.com> and Dmitry V. Dylov <d.dylov [at] skol.tech>

详情
AI中文摘要

背景:房颤(AF)是最常见的心律失常,也是预后的主要决定因素。现有的AF风险评分依赖于在心血管疾病(CVD)患者中几乎普遍存在的因素(如高龄、高血压),因此在该高风险群体中提供的分层有限。大多数评分针对长期(5-10年)而非中期预测。我们开发了可解释的ML模型,利用常规收集的医院数据预测CVD患者在24个月和整个随访期间内的AF风险。方法:对俄罗斯国家心脏病学研究中心电子健康记录进行单中心回顾性研究,纳入2012年1月至2019年5月期间多次住院、年龄≥18岁、患有CVD但无既往AF的患者。自定义NLP流水线将非结构化出院报告转化为73个结构化特征,结合基于规则的解析器和基于Transformer的命名实体识别。使用LightAutoML构建了完整模型(73个特征)、简单模型(简化子集)以及用于床旁风险评分的线性模型。性能通过ROC AUC评估,并与CHARGE-AF、C2HEST、MHS和HAVOC进行比较,并通过SHAP进行解释。结果:在来自45,000名患者的80,576份记录中,17,562份符合纳入标准;其中1,438名(8.19%)发生AF。完整模型在24个月和整个随访期间的ROC AUC分别为0.735和0.696;简单模型几乎相同(0.725和0.696)。所有非线性模型均优于四个临床风险评分(ROC AUC 0.53-0.64)。简单模型使用13个特征,命名为Pre-AF 13。SHAP识别出年龄和左心房容积为主要预测因子。线性风险评分(Pre-AF 9)将观察到的24个月AF发生率从约7%分层至36%。结论:基于常规收集的EHR数据构建的可解释ML模型能够识别高AF风险的CVD患者,优于现有的临床风险评分。

英文摘要

Background. Atrial fibrillation (AF) is the most prevalent cardiac arrhythmia and a major determinant of prognosis. Established AF risk scores rely on factors (older age, hypertension) nearly ubiquitous among patients with cardiovascular disease (CVD), offering limited stratification in this high-risk group. Most target long-term (5-10 year) rather than medium-term prediction. We developed interpretable ML models predicting AF risk over a 24-month and entire follow-up horizon in CVD patients using routinely collected hospital data. Methods. Single-center retrospective study of electronic health records from the National Research Cardiology Center (Russia) for patients aged >=18 with CVD but without pre-existing AF, hospitalized more than once between January 2012 and May 2019. A custom NLP pipeline transformed unstructured discharge reports into 73 structured features, combining a rule-based parser with transformer-based NER. Using LightAutoML we built a full model (73 features), a simple model (reduced subset), and a linear model for a bedside risk score. Performance was assessed by ROC AUC, compared with CHARGE-AF, C2HEST, MHS, and HAVOC, and interpreted via SHAP. Results. Of 80,576 records from 45,000 patients, 17,562 met inclusion criteria; 1,438 (8.19%) developed AF. The full model reached ROC AUC 0.735 (24-month) and 0.696 (entire follow-up); the simple model was nearly identical (0.725, 0.696). All non-linear models outperformed the four clinical risk scores (ROC AUC 0.53-0.64). The simple model uses 13 features and is named Pre-AF 13. SHAP identified age and left atrial volume as dominant predictors. A linear risk score (Pre-AF 9) stratified observed 24-month AF incidence from ~7% to 36%. Conclusion. Interpretable ML models built from routinely collected EHR data identify high-AF-risk CVD patients, outperforming established clinical risk scores.

2606.10639 2026-06-11 cs.RO 版本更新

Planar-Sector LOS Guidance for Interception of Agile Targets with Lifting-Wing Quadcopters

面向敏捷目标拦截的升力翼四旋翼平面扇形视线制导

Linkai Liu, Kun Yang, Han Zou, Chen Min, Shuli Lv, Shuai Wang, Quan Quan

发表机构 * School of Automation Science and Electrical Engineering, Beihang University(北京航空航天大学自动化科学与电气工程学院) Research and Development Department, China Academy of Launch Vehicle Technology(中国运载火箭技术研究院研发部)

AI总结 提出平面扇形视线(PS-LOS)制导框架,通过非对称约束释放机动性,使升力翼四旋翼在仅用单目相机的情况下实现远程自主拦截敏捷目标,实验验证了高达138米距离的成功拦截。

Comments Accepted to the IEEE International Conference on Robotics and Automation (ICRA 2026). Recipient of the ICRA 2026 Best Paper Award in Field and Service Robotics

详情
AI中文摘要

由于目标运动不可预测、感知受限以及目标可见性与拦截器机动性之间的强耦合,对敏捷空中目标的自主视觉拦截具有挑战性。大多数现有的捷联相机拦截方法使用锥形视线(LOS)约束来保持目标靠近图像中心,从而保证可见性。虽然安全,但这种对称约束不必要地限制了机动性,并可能显著减少可用于追击的推力。受激进FPV飞行员不在所有图像方向上保持相等可见性裕度的观察启发,本文提出了一种平面扇形视线(PS-LOS)制导框架,用于仅配备捷联单目相机的升力翼四旋翼的自主拦截。PS-LOS严格约束横向图像误差,同时放松纵向图像误差在安全的视场裕度内,在保持可见性的同时释放机动性以进行加速密集型追击。在升力翼四旋翼模型下,PS-LOS在LOS方向附近提供的可用推力比传统锥形LOS约束多近50%。为了实现无需直接深度测量的仅视线拦截,为升力翼四旋翼开发了延迟补偿状态估计框架和非线性制导与控制架构。广泛的外场飞行实验证明了在真实风扰动下,对具有大幅、高频和不可预测运动的敏捷目标的自主拦截。所提出的系统在高达138米的距离上实现了成功拦截,并在整个交战过程中保持连续视觉跟踪。结果验证了PS-LOS作为一种保持可见性、感知机动性的制导框架,用于远程视觉拦截敏捷空中目标。

英文摘要

Autonomous visual interception of agile aerial targets is challenging due to unpredictable target motion, limited sensing, and the strong coupling between target visibility and interceptor maneuverability. Most existing strapdown-camera interception methods preserve visibility using conic line-of-sight (LOS) constraints that keep the target near the image center. While safe, such symmetric constraints unnecessarily restrict maneuverability and can significantly reduce the usable thrust for pursuit. Motivated by the observation that aggressive FPV pilots do not maintain equal visibility margins in all image directions, this paper proposes a Planar-Sector Line-of-Sight (PS-LOS) guidance framework for autonomous interception using a lifting-wing quadcopter equipped with only a strapdown monocular camera. PS-LOS tightly constrains lateral image error while relaxing longitudinal image error within a safe field-of-view margin, preserving visibility while releasing maneuverability for acceleration-intensive pursuit. Under the lifting-wing quadcopter model, PS-LOS provides nearly 50% more available thrust near the LOS direction than conventional conic LOS constraints. To realize LOS-only interception without direct depth measurements, a delay-compensated state-estimation framework and a nonlinear guidance-and-control architecture are developed for lifting-wing quadcopters. Extensive outdoor flight experiments demonstrate autonomous interception of agile targets exhibiting large-amplitude, high-frequency, and unpredictable motion under real wind disturbances. The proposed system achieves successful interceptions at ranges up to 138 m while maintaining continuous visual tracking throughout the engagement. The results validate PS-LOS as a visibility-preserving, maneuverability-aware guidance framework for long-range visual interception of agile aerial targets.

2606.10401 2026-06-11 cs.CV 版本更新

CoCoSI: Collaborative Cognitive Map Construction for Spatial Intelligence

CoCoSI: 面向空间智能的协作认知地图构建

Yiming Zhang, Ruoxuan Cao, Zhihang Zhong

发表机构 * Shanghai Jiao Tong University(上海交通大学) Cornell University(康奈尔大学)

AI总结 提出一种即插即用的多智能体框架,通过协作构建结构化认知地图作为空间记忆,无需修改架构或额外训练即可增强预训练多模态大模型的空间理解能力。

详情
AI中文摘要

空间智能是多模态大语言模型(MLLMs)的一个关键前沿,使其能够从视觉体验中推理物理世界。受人类空间认知启发,最近的方法从多帧视觉输入构建基于网格的认知地图,以随时间维持连贯的空间表示。然而,有限的上下文长度仍然挑战空间理解,而现有方法如长上下文建模和外部记忆通常需要架构更改、记忆模块或微调,限制了其对现成预训练MLLMs的适用性。这促使我们提出一种轻量级、模型无关的方法,以在原生上下文窗口之外保留空间信息。为此,我们提出一个即插即用的多智能体框架,协作构建认知地图作为结构化空间记忆,无需架构修改或额外训练即可增强任意预训练MLLMs的空间理解。我们的框架具有局部-全局智能体协调、原子提交的认知地图构建以及跨智能体验证的特点。大量实验表明,我们的方法在空间理解任务上取得了优越性能,同时完全无需训练。代码将发布。

英文摘要

Spatial intelligence is a key frontier for multimodal large language models (MLLMs), enabling them to reason about the physical world from visual experience. Inspired by human spatial cognition, recent approaches construct grid-based cognitive maps from multi-frame visual inputs to maintain coherent spatial representations over time. However, limited context lengths still challenge spatial understanding, while existing methods, such as long-context modeling and external memory, often require architectural changes, memory modules, or finetuning, limiting their applicability to off-the-shelf pretrained MLLMs. This motivates a lightweight, model-agnostic method for preserving spatial information beyond the native context window. To this end, we propose a plug-and-play multi-agent framework that collaboratively constructs cognitive maps as structured spatial memory, enhancing the spatial understanding of arbitrary pretrained MLLMs without architectural modification or additional training. Our framework features local-global agent coordination, cognitive map construction with atomic commits, and cross-agent verification. Extensive experiments demonstrate that our method achieves superior performance on spatial understanding tasks while remaining fully training-free. Code will be released.

2606.10360 2026-06-11 cs.SD 版本更新

ViP-VL: Vietnamese Self-supervised Speech Pretraining Model with Vector-Quantization Learning

ViP-VL:基于向量量化学习的越南语自监督语音预训练模型

Khanh Le, Kiet Anh Hoang, Bao Nguyen, Duy Vo, Dung Vo, Thai Tran, Linh Pham, Khoa D Doan

发表机构 * VinUniversity(越南 Vin 大学)

AI总结 提出ViP-VL模型,通过声学堆叠、感受野对齐和掩码选择策略,在BEST-RQ框架上实现高效自监督预训练,在越南语ASR、情感识别、方言分类和说话人验证四项任务上取得最优结果。

Comments Accepted to INTERSPEECH 2026

详情
AI中文摘要

我们提出了ViP-VL,一种高效的越南语自监督语音预训练模型,利用向量量化学习。为了弥合高分辨率音频与高效处理之间的差距,ViP-VL在ChunkFormer架构中引入了声学堆叠和感受野对齐,实现了同步的8倍下采样率,同时通过在BEST-RQ框架上的预训练中采用专门的掩码选择策略,进一步增强了表示的鲁棒性。在17,000小时未标注的越南语语音上预训练后,我们的模型在自动语音识别、语音情感识别、方言分类和说话人验证四个主要下游任务上建立了新的最优结果。为了促进未来研究和高性能越南语语音技术的发展,我们在此http URL公开发布了预训练权重和实现。

英文摘要

We present ViP-VL, an efficient Vietnamese Self-supervised speech Pretraining model leveraging Vector-quantization Learning. To bridge the gap between high-resolution audio and efficient processing, ViP-VL incorporates Acoustic Stacking and Receptive Field Alignment to enable a synchronized 8x subsampling rate within the ChunkFormer architecture, while further enhancing representation robustness through a specialized Mask Selection Strategy during pretraining on the BEST-RQ framework. Pretrained on 17,000 hours of unlabeled Vietnamese speech, our model establishes new state-of-the-art results across four major downstream tasks: Automatic Speech Recognition, Speech Emotion Recognition, Dialect Classification, and Speaker Verification. To facilitate future research and the development of high-performance Vietnamese speech technologies, we publicly release our pretrained weights and implementation at github.com/khanld/chunkformer.

2606.10198 2026-06-11 cs.LG cs.AI cs.CV 版本更新

Density Ridge Selective Prediction for LLM and VLM Hallucination Detection under Calibration Label Scarcity

密度脊选择性预测:校准标签稀缺下的大语言模型与视觉语言模型幻觉检测

Nina I. Shamsi

发表机构 * Northeastern University Boston, United States(东北大学波士顿分校)

AI总结 针对校准标签稀缺时大语言模型和视觉语言模型的幻觉检测问题,提出基于核密度估计的密度脊方法,利用隐藏状态生成轨迹的六维运动特征图构建响应流形,通过到最近脊顶点的欧氏距离评分,在标签稀缺协议下AUROC提升5-20点。

详情
AI中文摘要

大语言模型和视觉语言模型中的幻觉检测日益被框架化为选择性预测,其中检测器分配置信度分数并在置信度低时弃权。无监督采样检测器(Semantic Entropy, EigenScore)避免标签但质量停滞,而有监督探针(SAPLMA)获得更强的分布内分数,但在校准标签稀缺时性能急剧下降。我们将大语言模型的响应流形恢复为基于隐藏状态生成轨迹的六维运动特征图的核密度估计的密度脊。测试生成通过其投影特征点到最近脊顶点的欧氏距离的负值进行评分,从而得到随机输出分布的低维几何骨架。我们在七个问答基准(HaluEval-QA, TriviaQA, GSM8K, POPE, ScienceQA, A-OKVQA)上,使用九个文本和视觉大语言模型,在刻意标签稀缺协议($n_{\ ext{cal}}{=}200$ 查询,$N{=}5$ 生成)下,与Semantic Entropy、SAR、EigenScore、SAPLMA和对数概率进行评估。我们的基于脊的分数在AUROC上以5-20个百分点的优势获胜,同时在校准标签稀缺下表现出温和的性能下降。

英文摘要

Hallucination detection in large language and vision-language models is increasingly framed as selective prediction, where a detector assigns a confidence score and abstains when confidence is low. Unsupervised sampling detectors (Semantic Entropy) avoid labels but plateau in quality, while supervised probes attain stronger in-distribution scores yet degrade sharply when calibration labels are scarce. We recover the response manifold of an LLM as the density ridge of a kernel density estimate built on a six-dimensional kinematic feature map of hidden state generation trajectories. A test generation is scored by the negated Euclidean distance from its projected feature point to the nearest ridge vertex, yielding a low-dimensional geometric skeleton of the stochastic output distribution. We evaluate against Semantic Entropy, topological methods, and log-probability on six QA benchmarks (HaluEval-QA, TriviaQA, GSM8K, POPE, ScienceQA, A-OKVQA) using eight text and vision LLMs in a deliberately label-scarce protocol ($n_{\text{cal}}{=}200$ queries, $N{=}5$ generations). Our ridge-based score beats on AUROC with 5-20 points gain, while demonstrating tempered degradation under calibration-label scarcity.

2606.10135 2026-06-11 cs.CV cs.AI 版本更新

BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression

BiWM:利用双向自回归推进开源交互式视频世界模型

Shaohao Rui, Xiaofeng Mao, Zhanyu Zhang, Peijia Lin, Yansong Zhu, Yibo Zhang, Haibin Wan, Weijie Ma

发表机构 * LynnReal AI Shanghai Innovation Institute(上海创新研究院) Shanghai Jiao Tong University(上海交通大学) Fudan University(复旦大学)

AI总结 提出BiWM框架,通过双向自回归范式将预训练视频骨干转化为交互式世界模型,仅需两阶段训练(微调+分布匹配蒸馏),支持多尺度模型和长程生成,优于现有因果流水线。

Comments After the paper was posted, we discovered that several visualization results were produced using wrong configuration settings during runtime. This error affects the reliability of the presented visual comparisons. Additionally, further optimization of the design is needed. We therefore request to withdraw this version and will submit a corrected and improved version later

详情
AI中文摘要

将双向视频扩散模型过渡到自回归范式提高了视频世界模型的交互性,但现有的因果流水线需要多个阶段(控制微调、自回归训练、因果初始化、少步蒸馏),并且由于误差累积,质量仍落后于双向模型。最近的世界模型如Yume-1.5和Matrix-Game-3.0采用双向自回归方法,通过自我纠正误差传播获得保真度和稳定的长程展开,但开源框架(如minWM)仅支持因果模型。我们提出BiWM,这是首个在双向自回归范式下用于交互式视频世界模型的全栈框架,联合优化生成质量和推理速度。从预训练视频骨干开始,BiWM通过微调注入相机控制,然后运行几步分布匹配蒸馏(DMD)阶段,将骨干转化为动作/相机可控的世界模型:仅需两个训练阶段(而非minWM的四个),在8xH200 GPU上几百步内收敛。单一方案覆盖Wan2.1-1.3B、Wan2.2-5B、HunyuanVideo-1.5-8B和LTX-2.3-22B,并支持现有双向模型的二次微调。BiWM实现了minWM失去可控性的真实相机控制,集成了可插拔历史压缩(FramePack风格和PackForcing风格)用于长程展开,并提供可选的NVFP4 4位训练/推理流水线。为对抗DMD的模式寻求退化,我们添加了GAN和覆盖前向KL目标,以保留场景动态。我们开源BiWM,用于资源受限的研究和高保真环境模拟。

英文摘要

Transitioning bidirectional video diffusion models into an autoregressive paradigm improves the interactivity of video world models, but existing causal pipelines need many stages (control fine-tuning, autoregressive training, causal initialization, few-step distillation) and still trail bidirectional models in quality due to error accumulation. Recent world models such as Yume-1.5 and Matrix-Game-3.0 instead adopt a bidirectional autoregressive approach, gaining fidelity and stable long-horizon rollout from self-correcting error propagation, yet open-source frameworks (e.g., minWM) support only causal models. We present BiWM, the first full-stack framework for interactive video world models under the bidirectional autoregressive paradigm, jointly optimizing generation quality and inference speed. From a pretrained video backbone, BiWM injects camera control by fine-tuning, then runs a few-step Distribution Matching Distillation (DMD) stage that turns the backbone into an action/camera-controllable world model: just two training stages instead of four in minWM, converging in a few hundred steps on 8xH200 GPUs. A single recipe spans Wan2.1-1.3B, Wan2.2-5B, HunyuanVideo-1.5-8B, and LTX-2.3-22B, and also supports secondary fine-tuning of existing bidirectional models. BiWM enables real-world camera control where minWM loses controllability, integrates pluggable history compression (FramePack-style and PackForcing-style) for long rollouts, and offers an optional NVFP4 4-bit training/inference pipeline. To counter DMD's mode-seeking degradation, we add GAN and mass-covering forward-KL objectives that preserve scene dynamics. We open-source BiWM for resource-constrained research and high-fidelity environment simulation.

2606.10046 2026-06-11 cs.SD cs.AI 版本更新

Inside the Latent Flow: Causal Deciphering of Attention Dynamics in Audio Separation Foundation Models

潜流内部:音频分离基础模型中注意力动力学的因果解读

Yuxuan Chen, Haoyuan Yu, Peize He

发表机构 * Jilin University(吉林大学) Hunan University(湖南大学) University of Electronic Science and Technology of China(电子科学与技术大学)

AI总结 本文通过因果干预协议揭示流匹配Transformer在音频分离中的双路径注意力机制,并提出无训练加速方法LSAC,在保持质量的同时减少约25%自注意力计算。

详情
AI中文摘要

流匹配变压器实现了强大的音频分离,但其注意力动力学是不透明的。我们将已建立的因果干预原则适应为SAM Audio的确定性推理时探测协议。正交探测揭示了一种双路径文本条件机制:加法注入控制语义身份,而交叉注意力细化声学结构。我们观察到异步逐层收敛:稳定层早期构建时间支架,而快速层在采样过程中继续解决伪影。该模型还减弱时间分割线索以维持连续流稳定性。利用这些见解,我们提出了层选择性注意力缓存(LSAC),一种无训练加速方法,在稳定层中缓存注意力。在各种声学复杂度下,LSAC将自注意力计算减少约25%,质量损失可忽略,并且与朴素步长减少相比,质量保持率高达6.7倍。

英文摘要

Flow-matching transformers achieve strong audio separation, yet their attention dynamics are opaque. We adapt established causal-intervention principles into a deterministic, inference-time probing protocol for SAM Audio. Orthogonal probing uncovers a dual-pathway text-conditioning mechanism: additive injections control semantic identity, while cross-attention refines acoustic structure. We observe an asynchronous layerwise convergence: stable layers build temporal scaffolds early, whereas fast layers continue resolving artifacts during sampling. The model also attenuates temporal segmentation cues to maintain continuous-flow stability. Using these insights, we propose Layer-Selective Attention Caching (LSAC), a training-free acceleration method that caches attention in stable layers. Across acoustic complexities, LSAC cuts self-attention computation by about ~25% with negligible quality loss and yields up to 6.7x higher quality retention than naive step reduction.

2606.10040 2026-06-11 cs.RO 版本更新

Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination

Efficient-WAM: 一种具有低成本未来想象能力的10亿参数世界-动作模型

Jiajun Li, Tiecheng Guo, Yifan Ye, Rongyu Zhang, Xiaowei Chi, Qianpu Sun, Ying Li, Yunfan Lou, Yan Huang, Zhihe Lu, Meng Guo, Shanghang Zhang

发表机构 * The University of Hong Kong(香港大学) Peking University(北京大学) Muka Robotics(Muka机器人) Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所) Nanjing University(南京大学)

AI总结 提出Efficient-WAM,通过紧凑视频专家、稀疏视频潜变量和非对称去噪降低未来想象成本,在保持控制性能的同时实现30倍推理加速。

详情
AI中文摘要

世界-动作模型(WAM)通过将未来视觉预测与动作生成相结合,已成为具身控制的一种有前景的范式。然而,大多数现有WAM依赖于逼真的未来预测,这导致高推理延迟,使得实时机器人部署困难。这促使设计一种更高效的WAM,既能保留未来视觉预测的控制优势,又能降低其推理成本。我们引入了Efficient-WAM,一种在保留控制优势的同时降低未来想象成本的世界-动作模型。Efficient-WAM通过从WAN-2.2-5B迁移的紧凑视频专家、稀疏视频潜变量以及非对称视频-动作去噪(为视频分配比动作更少的采样步骤)来提高推理效率。Efficient-WAM不优化未来分支的视觉保真度,而是将未来视频预测视为动作生成的紧凑指导信号。在RoboTwin 2.0和真实世界操作任务上的综合实验表明,尽管未来预测明显粗糙,Efficient-WAM仍能保持强大的动作性能。在保持竞争性控制能力的同时,我们的10亿参数模型在物理部署中可将每块延迟降低至约100毫秒,相比现有WAM实现了30倍的加速。

英文摘要

World-Action Models (WAMs) have emerged as a promising paradigm for embodied control by coupling future visual prediction with action generation. However, most existing WAMs rely on photorealistic future prediction, which incurs high inference latency and makes real-time robot deployment difficult. This motivates a more efficient WAM design that preserves the control benefits of future visual prediction while reducing its inference cost. We introduce Efficient-WAM, a World-Action Model that reduces the cost of future imagination while preserving its control benefit. Efficient-WAM improves inference efficiency via a compact video expert transferred from WAN-2.2-5B, token-sparse video latents, and asymmetric video-action denoising that allocates fewer sampling steps to video than to actions. Instead of optimizing the future branch for visual fidelity, Efficient-WAM treats future video prediction as a compact guidance signal for action generation. Comprehensive experiments on RoboTwin 2.0 and real-world manipulation tasks show that Efficient-WAM maintains strong action performance despite visibly coarse future predictions. While maintaining competitive control capabilities, our 1B-parameter model can reduce per-chunk latency to around 100 ms during physical deployment, achieving a 30x speedup over existing WAMs.

2606.11118 2026-06-11 cs.LG math.OC math.PR stat.AP stat.ML 版本更新

Data-Driven Dynamic Assortment in Online Platforms: Learning about Two Sides

在线平台中的数据驱动动态分类:学习双边信息

Rahul Roy, Nur Sunar, Jayashankar M. Swaminathan

发表机构 * IE Business School, IE University(IE大学商学院) Kenan-Flagler Business School, The University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校肯纳-弗拉格勒商学院)

AI总结 针对双边服务平台,提出一种数据驱动算法,在未知顾客和卖家选择参数的情况下动态优化商品分类,并证明其遗憾值随时间呈多对数增长且达到最优速率。

详情
AI中文摘要

我们研究了一个在离散时间环境下,具有不完全信息和异质顾客的双边服务平台上的动态分类问题。在每个周期,一位顾客到达寻求服务,平台选择一组卖家进行展示。顾客根据多项逻辑选择模型,最多向分类中的一个卖家提出交易。经过固定数量的周期后,卖家审查收到的提议,并根据另一个多项逻辑选择模型,每位卖家最多选择一个顾客,然后循环重复。一个关键挑战是平台事先不知道顾客或卖家的选择模型参数。据我们所知,这是首次研究双边选择参数均未知的动态分类问题。我们开发了一种数据驱动算法,该算法在优化平台目标的同时学习这些参数。我们使用遗憾值来评估性能,该遗憾值衡量相对于一个预知所有参数和顾客到达时间的先知基准的收入损失。我们证明该算法的最坏情况遗憾值随时间呈多对数增长,并推导出匹配的下界,从而确定其速率最优性。

英文摘要

We study a dynamic assortment problem on a two-sided service platform with incomplete information and heterogeneous customers in a discrete-time setting. In each period, a customer arrives seeking service, and the platform chooses an assortment of sellers to display. The customer then proposes a transaction to at most one seller in the assortment according to a multinomial logit choice model. After a fixed number of periods, sellers review the proposals they have received and each chooses at most one customer according to another multinomial logit choice model, after which the cycle repeats. A key challenge is that the platform does not know the choice-model parameters of either customers or sellers in advance. To our knowledge, this is the first study of a dynamic assortment problem in which both sides' choice parameters are unknown. We develop a data-driven algorithm that learns these parameters while optimizing the platform's objective over time. We evaluate performance using regret, which measures revenue loss relative to a clairvoyant benchmark that knows all parameters and customer arrivals in advance. We show that the algorithm's worst-case regret grows polylogarithmically over time, and we derive a matching lower bound, establishing its rate optimality.

2606.09744 2026-06-11 cs.LG cond-mat.dis-nn 版本更新

Learning Dynamics Reveal a Hierarchy of Weight-Induced Layerwise Gram Metrics

学习动力学揭示权重诱导的分层Gram度量层次结构

Claudio Nordio

发表机构 * GitHub arXiv

AI总结 本文研究前馈ReLU网络在固定读出和二次损失下的梯度下降动力学,将其重写为训练集空间上的集体动力学,并揭示深度网络中权重诱导的Gram算子层次结构。

Comments 24 pages. v4: Corrected the hidden-activation dynamics; clarified the concept of field closure. Other minor corrections

详情
AI中文摘要

我们研究具有固定读出和二次损失的前馈ReLU网络。目的是将梯度下降重写为一种集体动力学,而非主要作为权重空间中的动力学,该动力学在训练集空间上定义的场中封闭。对于单隐层,可以从激活动力学中消除权重变量,得到残差的封闭方程,该方程由一个集体核支配,该核分解为输入几何矩阵和动态共激活矩阵。对于更深网络,残差动力学保持清晰的分层核结构。然而,从深度三开始,封闭需要权重诱导的Gram算子层次结构,这些算子介导跨层的信息传输。

英文摘要

We study feed-forward ReLU networks with fixed readout and quadratic loss. The aim is to rewrite gradient descent not primarily as a dynamics in weight space, but as a collective dynamics closed in terms of fields defined on the training-set space. For a single hidden layer, the weight variables can be eliminated from the activation dynamics, yielding a closed equation for the residuals governed by a collective kernel that factorizes into an input-geometric matrix and a dynamical co-activation matrix. For deeper networks, the residual dynamics retains a clean layer-wise kernel structure. However, from depth three onward, closure requires a hierarchy of weight-induced Gram operators that mediate information transport across layers. Moreover, the conjugate-field dynamics is governed by operators satisfying a backward pullback recursion, of which the weight-induced Gram operators are the first nontrivial instances.