arXivDaily arXiv每日学术速递 周一至周五更新

高校专区

University of Edinburgh(爱丁堡大学)

至 收录 694
2607.17890 2026-07-21 cs.AI 新提交

Stress Testing Concept Erasure with Large Language Model Agents

用大语言模型智能体对概念擦除进行压力测试

Yuyang Xue, Feng Chen, Zhihua Liu, Edward Moroshko, Jingyu Sun, Steven McDonagh, Sotirios A. Tsaftaris

机构 * School of Engineering, University of Edinburgh(爱丁堡大学工程学院) The University of Manchester(曼彻斯特大学) The University of Melbourne(墨尔本大学)

AI总结 研究针对概念擦除评估面临的验证挑战,提出STACE框架,利用大语言模型智能体迭代生成并验证压力测试假设,通过一套指标评估性能效率,经实验证明该框架在多方面表现优异且可拓展到其他领域。

详情
AI中文摘要

概念擦除旨在从训练好的生成模型中去除语义概念,这对负责任的人工智能部署愈发重要。然而,验证模型是否已稳健地去除目标概念仍是一项关键挑战。现有评估方法通常是预定义且静态的,无法揭示在各种自然语言探测和具有挑战性条件下的漏洞。此外,手动设计的评估策略可能存在偏差且难以扩展。我们认为概念擦除评估最好被表述为一种自适应假设搜索,由智能体迭代地提出、批判和验证测试以系统地扩大故障模式的覆盖范围来实施。为此,我们提出了用于概念擦除的压力测试智能体(STACE)框架,它通过基于外部知识迭代地生成和验证压力测试假设,使用多个大语言模型智能体自主地对概念擦除模型进行压力测试。我们还引入了一套用于评估基于大语言模型智能体的压力测试框架的性能和效率的指标。我们的广泛实验表明,STACE在四个概念类别上优于五个基于大语言模型的评估基线。对两个文本到图像模型、六种概念擦除方法和各种擦除强度的进一步分析表明,STACE在不同设置下都很稳健。我们还表明,STACE可以超越概念擦除评估应用于其他问题领域,如大语言模型越狱。我们的代码可匿名获取。

英文摘要

Concept erasure aims to remove semantic concepts from a trained generative model and is increasingly important for responsible AI deployment. However, verifying whether a model has robustly removed targeted concepts remains a critical challenge. Existing evaluation methods are typically pre-defined and static, failing to expose vulnerabilities under diverse natural-language probes and challenging conditions. Moreover, manually designed evaluation strategies can be biased and difficult to scale. We posit that concept erasure evaluation is best formulated as an adaptive hypothesis search, operationalised by agents that iteratively propose, critique, and verify tests to systematically expand coverage of failure modes. To this end, we propose Stress Testing Agents for Concept Erasure (STACE), a framework that autonomously stress-tests concept-erased models using multiple Large Language Model (LLM) agents, by iteratively generating and verifying stress-testing hypotheses grounded by external knowledge. We also introduce a suite of metrics for assessing the performance and efficiency of LLM-agent-powered stress-testing frameworks. Our extensive experiments show that STACE outperforms five LLM-based evaluation baselines on four concept categories. Further analysis across two T2I models, six concept erasure approaches, and various erasure strengths show that STACE is robust for different settings. We also show that STACE can be adapted beyond concept erasure evaluation to other problem domains, such as LLM jailbreaking. Our code is available anonymously.

URL PDF HTML 收藏
2607.16372 2026-07-21 cs.SE cs.AI cs.LG cs.PL 新提交

AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language

AoA:基于重新设计语言抽象语法树的定理证明智能体

Qiyuan Xu, Joshua Ong Jun Leang, Renxi Wang, Wenda Li, Haonan Li, Luke Ong, Conrad Watt

机构 * Nanyang Technological University Singapore(南洋理工大学新加坡分校) Imperial College London London, UK(伦敦帝国理工学院伦敦分校) University of Edinburgh Edinburgh, UK(爱丁堡大学爱丁堡分校)

AI总结 研究针对交互式定理证明中人工操作限制可扩展性及基于LLM的证明智能体成本高的问题,提出将智能体从源文本提升到抽象语法树的方法,实现了AoA,在多个方面有显著提升且解决更多难题。

Comments 13 pages

详情
AI中文摘要

交互式定理证明(ITP)是程序验证和形式化数学的基础,但人工操作限制了其可扩展性。基于大语言模型(LLM)的证明智能体有望减轻这一负担,但其高昂的令牌消耗和API成本仍是主要障碍。我们将此成本追溯到一个共同根源:当前智能体在序列化的具体语法上运行,将证明作为源文本发出,并通过单独的基于行号的查询恢复证明状态,因此每次编辑都会移动后续行,并迫使错误和状态重复重新定位。对具体语法的这种依赖也阻碍了Minilang的采用,Minilang是一种最近的证明语言,在基于LLM的证明方面达到了当前最优水平,但对于LLMs的训练语料库来说太新了。我们通过将智能体从源文本提升到抽象语法树(AST)来解决这两个问题:模型以Minilang的AST的JSON表示形式提供证明,这是工具调用LLMs原生的,并通过树编辑模型驱动证明器,该模型将证明操作和状态融合到一个证明树中,因此每个操作都携带其自己子目标的状态,可直接从树中读取。我们在“AST上的智能体”(AoA)中实现了这一设计。与亚马逊的Isabelle智能体在miniF2F和NTP4VC-Pearl常见成功集上相比,AoA将API成本降低了2.3-4.7倍(归一化输入缓存计算),使用的令牌减少了2.9-6.9倍,工具调用减少了3.9-8.9倍,并完成速度快1.4-2.0倍,同时在更难的验证基准上解决了更多问题。

英文摘要

Interactive theorem proving (ITP) underpins program verification and formalized mathematics, but its manual effort limits scalability. LLM-based proof agents promise to ease this effort, but their heavy token consumption and API cost remain a major obstacle. We trace this cost to a shared root: current agents operate on serialized concrete syntax, emitting proofs as source text and recovering proof states through separate, line-number-based queries, so every edit shifts later lines and forces repeated relocation of errors and states. This same dependence on concrete syntax also blocks adoption of Minilang, a recent proof language that reaches SOTA on LLM-based proving but is too new for LLMs' training corpora. We address both problems by lifting the agent off source text and onto the abstract syntax tree (AST): the model supplies proofs as JSON representations of Minilang's AST -- native to tool-calling LLMs -- and drives the prover through a tree-edit model that fuses proof operations and states into one proof tree, so each operation carries its own subgoal's state, readable directly off the tree. We realize this design in \emph{Agent over AST} (AoA). Against Amazon's Isabelle Agent on miniF2F and NTP4VC-Pearl common success sets, AoA cuts API cost by 2.3--4.7x (normalized input-cache accounting), uses 2.9--6.9x fewer tokens and 3.9--8.9x fewer tool calls, and finishes 1.4--2.0x faster -- while also solving far more problems on the harder verification benchmark.

URL PDF HTML 收藏
2607.16311 2026-07-21 cs.CV cs.AI 新提交

Seeing What Is Actually There: PriVE-Bench and PriVE-Tools for Counterfactual Evaluation of Agentic Visual Evidence in VLMs

看清实际存在的东西:用于在视觉语言模型中对代理视觉证据进行反事实评估的PriVE-Bench和PriVE-Tools

Jingyu Sun, Jiachen Tu, Yuyang Xue, Yaoxin Jiang, Guoyi Xu, Zhengtao Yao, Rui Qian, Yizheng Sun, Hongpeng Zhou, Jingyuan Sun, Yan Lin

机构 * The University of Manchester(曼彻斯特大学) The University of Melbourne(墨尔本大学) University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) University of Edinburgh(爱丁堡大学) University of Southern California(南加州大学) Fudan University(复旦大学) University of Newcastle(纽卡斯尔大学)

AI总结 本文针对视觉语言模型常依先验而非图像回答问题的现象,引入PriVE-Bench和PriVE-Tools。通过配对图像及工具衍生证据评估模型,对比不同输入,发现视觉证据工具在特定情况有帮助,但不能解决所有模型依先验回答的问题。

详情
AI中文摘要

视觉语言模型(VLMs)常依据学习到的语言和类别先验回答视觉问题,而非基于图像本身。反事实图像为这种失败模式提供了自然诊断场景。现有反事实基准主要询问先验跟随行为是否存在,本文进一步探讨:额外视觉证据视图能否帮助VLMs对抗先验?为此引入PriVE-Bench,用配对的原始图像和反事实图像区分基于视觉的答案和与先验一致的错误。还引入PriVE-Tools评估工具衍生的视觉证据是否改善反事实冲突下的基础。通过对比不同输入,结果显示视觉证据工具在某些情况下有帮助,但并非通用解决方案。

英文摘要

Vision-language models (VLMs) often answer visual questions using learned language and category priors rather than grounding their predictions in the image itself. Counterfactual images provide a natural diagnostic setting for this failure mode: when visible evidence contradicts what is usually true, a grounded model should answer from the pixels, while a prior-following model will produce a canonical but visually incorrect response. However, existing counterfactual benchmarks mainly ask whether such prior-following behavior exists. In this paper, we ask a further question motivated by the rise of tool-augmented and agentic vision systems: can additional visual evidence views help VLMs reason against their priors? We introduce PriVE-Bench, a Prior-vs-Visual Evidence Benchmark that uses paired original and counterfactual images to distinguish visually grounded answers from prior-consistent errors. We further introduce PriVE-Tools, a controlled agentic-vision-inspired extension that evaluates whether tool-derived visual evidence -- including bounding boxes, crops, zoom panels, and contours -- improves grounding under the same counterfactual conflicts. Across open- and closed-source VLMs, we compare raw, paired-image, and tool-conditioned inputs using accuracy, prior-following error rate, and other-response rate. Our results show that visual evidence tools can help in some settings, especially when models can use localized evidence effectively, but they are not a universal remedy: several models continue to follow language and category priors even when relevant visual evidence is explicitly provided.

URL PDF HTML 收藏
2607.17872 2026-07-21 quant-ph cs.DC cs.ET cs.LG 新提交

Entanglement geometry separates circuit cutting, classical hardness, and trainability

纠缠几何分离电路切割、经典硬度和可训练性

Maria Gragera Garces, Sabina Drăgoi, Lirandë Pira

机构 * Quantum Software Lab(量子软件实验室) University of Edinburgh, UK(爱丁堡大学) IBM Research(IBM研究院) Centre for Quantum Technologies(量子技术中心) National University of Singapore(新加坡国立大学)

AI总结 研究表明纠缠几何约束电路切割等属性,具恒定接缝键维度的MPS和TTN电路可经典模拟,构建的双块电路家族可廉价切割,MPS硬度和可训练性深度范围不兼容,用魔法作硬度资源可避免冲突,浅Clifford+\(T\)电路有相应特性。

Comments 4 pages, 2 figures

详情
AI中文摘要

电路切割有望扩展量子计算规模,但变分量子优势还需低切割开销、经典硬度和可训练性。我们表明这些属性受纠缠几何强烈约束。具有恒定接缝键维度的矩阵乘积态(MPS)和树张量网络(TTN)电路可在\(O(1/\varepsilon^2)\)采样开销下切割,但仍可高效经典模拟,排除了这些家族内的渐近量子优势。通过独立控制接缝和块内纠缠,我们构建了一个双块电路家族,它可廉价切割且需要超多项式全局MPS键维度,数值上支持到\(n = 100\)。然而,MPS硬度和可训练性需要不兼容的深度范围,分别为\(d=\omega(\log n)\)和\(d=O(\log n)\)。使用魔法而非纠缠作为硬度资源可避免此冲突:浅的Clifford+\(T\)电路可切割且可训练,同时其稳定器模拟成本随\(T\)计数呈指数增长。

英文摘要

Circuit cutting promises to scale quantum computations beyond current hardware, but variational quantum advantage also requires low cutting overhead, classical hardness, and trainability. We show that these properties are strongly constrained by entanglement geometry. Matrix product state (MPS) and tree tensor network (TTN) circuits with constant seam bond dimension can be cut with \(O(1/\varepsilon^2)\) sampling overhead, but remain efficiently classically simulable, ruling out asymptotic quantum advantage within these families. By independently controlling seam and intra-block entanglement, we construct a two-block circuit family that remains cheaply cuttable while requiring a super-polynomial global MPS bond dimension, as supported numerically up to \(n=100\). However, MPS hardness and trainability require incompatible depth regimes, \(d=ω(\log n)\) and \(d=O(\log n)\), respectively. Using magic rather than entanglement as the hardness resource avoids this conflict: shallow Clifford+\(T\) circuits remain cuttable and trainable while their stabiliser-simulation cost grows exponentially with the \(T\)-count.

URL PDF HTML 收藏
2606.04165 2026-07-21 hep-ex cs.LG hep-ph physics.ins-det 版本更新

CaloTrilogy: Toward a Breakthrough in One-Step, End-to-End, Physics-Guided Shower Generation for Modern Calorimeters

CaloTrilogy:迈向现代量热器一步式端到端物理引导簇射生成的突破

Cheng Jiang, Sitian Qian, Kevin Pedro, Oz Amram, Huilin Qu, Maggie Voetberg

机构 * School of Physics and Astronomy, University of Edinburgh(爱丁堡大学物理与天文学学院) Department of Physics, University of Wisconsin-Madison(威斯康星大学麦迪逊分校物理系) Fermi National Accelerator Laboratory(费米国家加速器实验室) State Key Laboratory of Dark Matter Physics, Tsung-Dao Lee Institute & School of Physics and Astronomy, Shanghai Jiao Tong University(上海交通大学暗物质物理国家重点实验室、李政道研究所及物理与天文学学院) Key Laboratory for Particle Astrophysics and Cosmology (MOE) & Shanghai Key Laboratory for Particle Physics and Cosmology, Shanghai Jiao Tong University(教育部粒子天体物理与宇宙学重点实验室及上海粒子物理与宇宙学重点实验室,上海交通大学)

AI总结 提出一种结合平均速度场积分器、学习生成先验和物理引导损失项的框架,实现一步或少量评估步骤的高质量簇射生成,性能与最先进的流和扩散模型相当。

详情
AI中文摘要

当前和未来对撞机的高精度量热器模拟对计算资源的需求快速增长,促使开发机器学习替代传统蒙特卡洛工具(如Geant4)。流匹配和基于扩散的生成模型因其样本质量而成为高维快速模拟的主流方法,但通常在推理时需要${\cal O}(100)$次函数评估,并常依赖辅助网络约束全局可观测量,损害了简化的端到端生成。我们引入了一个统一框架,改进了速度、簇射质量和物理保真度之间的平衡。该方法结合了:(i)平均速度场积分器,实现一步或少量评估的采样;(ii)从数据而非随机噪声构建的簇射空间学习生成先验;(iii)训练期间对关键可观测量施加归纳偏置的物理引导损失项。这些元素是训练时的正则化器,保持了端到端推理且无额外成本。仅需一步或少量评估步骤,该模型在多个公开的高粒度量热器数据集上达到了与最先进的流和扩散模型竞争的簇射质量。结果表明层间簇射结构与底层物理一致,为未来的快速模拟工作流提供了有力候选。

英文摘要

High-precision calorimeter simulation at current and future colliders imposes rapidly growing computational demands, motivating the development of machine-learning surrogates for traditional Monte Carlo tools such as Geant4. Flow matching and diffusion-based generative models have become leading approaches for high-dimensional fast simulation because of their sample quality, but typically require ${\cal O}(100)$ function evaluations at inference and often rely on auxiliary networks to constrain global observables, compromising streamlined end-to-end generation. We introduce a unified framework that improves the balance between speed, shower quality, and physics fidelity. The method combines: (i) an average velocity field integrator that enables sampling in one or a few evaluations; (ii) a learned generative prior in shower space, constructed from data rather than random noise; and (iii) physics-guided loss terms that impose inductive biases on key observables during training. These elements are training time regularizers, preserving end-to-end inference with no additional cost. With only one or a few evaluation steps, the model achieves shower quality competitive with state-of-the-art flow and diffusion approaches, tested on several public high granularity calorimeter datasets. The results demonstrate inter-layer shower structure consistent with the underlying physics, providing a strong candidate for future fast simulation workflows.

URL PDF HTML 收藏
2604.11945 2026-07-21 cs.LG cs.AI cs.MA

AutoSurrogate: An LLM-Driven Multi-Agent Framework for Autonomous Construction of Deep Learning Surrogate Models in Subsurface Flow

AutoSurrogate:一种基于LLM的多智能体框架,用于自主构建地下流深度学习代理模型

Jiale Liu, Nanzhe Wang

机构 * School of Physics and Astronomy, The University of Edinburgh(物理与天文学学院,爱丁堡大学) Institute of GeoEnergy Engineering, School of Energy, Geoscience, Infrastructure and Society, Heriot-Watt University(地球能源工程研究所,能源、地质科学、基础设施与社会学院,赫瑞斯泰大学) Subsurface Energy Transition and Innovation Centre, Heriot-Watt University(地下能源转型与创新中心,赫瑞斯泰大学)

AI总结 AutoSurrogate通过自然语言指令使非ML专家能构建高质量地下流代理模型,利用多智能体协作完成数据分析、架构选择、超参数优化和质量评估,实现自动化代理模型构建。

详情
AI中文摘要

高保真地下流数值模拟计算成本高,尤其在多查询任务如不确定性量化和数据同化中更为明显。深度学习(DL)代理可以显著加速正向模拟,但构建它们需要大量的机器学习(ML)专业知识,包括架构设计和超参数调优,而大多数领域科学家不具备这些能力。此外,这一过程主要是手动的,依赖于启发式选择。为此,我们提出了AutoSurrogate,一种基于大语言模型的多智能体框架,使没有ML专业知识的从业者能够通过自然语言指令构建高质量的地下流代理模型。给定模拟数据和可选偏好,四个专门的智能体协作执行数据剖析、从模型库中选择架构、贝叶斯超参数优化、模型训练和与用户指定阈值的质量评估。系统还能够自主处理常见故障模式,包括在数值不稳定性发生时重新启动训练并调整配置,以及在预测准确性不足时切换到替代架构。在我们的设置中,一个自然语言句子足以生成部署就绪的代理模型,任何中间阶段所需的最小人工干预。我们通过一个三维地质碳储存建模任务展示了AutoSurrogate的实用性,将渗透率场映射到压力和CO₂饱和度场,覆盖31个时间步。在没有任何手动调优的情况下,AutoSurrogate能够超越专家设计的基线和领域无关的AutoML方法,显示出在实际部署中的强大潜力。

英文摘要

High-fidelity numerical simulation of subsurface flow is computationally intensive, especially for many-query tasks such as uncertainty quantification and data assimilation. Deep learning (DL) surrogates can significantly accelerate forward simulations, yet constructing them requires substantial machine learning (ML) expertise - from architecture design to hyperparameter tuning - that most domain scientists do not possess. Furthermore, the process is predominantly manual and relies heavily on heuristic choices. This expertise gap remains a key barrier to the broader adoption of DL surrogate techniques. For this reason, we present AutoSurrogate, a large-language-model-driven multi-agent framework that enables practitioners without ML expertise to build high-quality surrogates for subsurface flow problems through natural-language instructions. Given simulation data and optional preferences, four specialized agents collaboratively execute data profiling, architecture selection from a model zoo, Bayesian hyperparameter optimization, model training, and quality assessment against user-specified thresholds. The system also handles common failure modes autonomously, including restarting training with adjusted configurations when numerical instabilities occur and switching to alternative architectures when predictive accuracy falls short of targets. In our setting, a single natural-language sentence can be sufficient to produce a deployment-ready surrogate model, with minimum human intervention required at any intermediate stage. We demonstrate the utility of AutoSurrogate on a 3D geological carbon storage modeling task, mapping permeability fields to pressure and CO$_2$ saturation fields over 31 timesteps. Without any manual tuning, AutoSurrogate is able to outperform expert-designed baselines and domain-agnostic AutoML methods, demonstrating strong potential for practical deployment.

URL PDF HTML 收藏
2601.17108 2026-07-21 cs.LG cs.AI eess.SP 版本更新

Hybrid Mamba-Attention Neural Architecture for Channel Estimation

MambaNet:结合注意力机制的Mamba辅助信道估计神经网络

Dianxin Luan, Chengsi Liang, Jie Huang, Zheng Lin, Kaitao Meng, John Thompson, Cheng-Xiang Wang

机构 * Institute for Imaging, Data and Communications, School of Engineering, University of Edinburgh(影像、数据与通信研究所,工程学院,爱丁堡大学) James Watt School of Engineering, University of Glasgow(詹姆斯·瓦特工程学院,格拉斯哥大学) National Mobile Communications Research Laboratory, Southeast University(国家移动通信研究中心,东南大学) Purple Mountain Laboratories, Nanjing(紫金山实验室,南京) Department of Electrical and Electronic Engineering, The University of Hong Kong(电气与电子工程系,香港大学) Department of Electrical and Electronic Engineering, University of Manchester(电气与电子工程系,曼彻斯特大学)

AI总结 MambaNet通过结合自注意力机制和定制化Mamba架构,实现低复杂度的OFDM信道估计,尤其在大规模子载波配置中表现优异。

详情
AI中文摘要

本文提出了一种结合自注意力机制的Mamba辅助神经网络框架,以实现低复杂度的正交频分复用(OFDM)波形信道估计,特别是在子载波数量较大的配置中。通过集成定制化的Mamba架构,所提出的框架能够高效处理大规模子载波信道估计,并有效捕捉这些子载波之间的长距离依赖关系。与传统Mamba结构不同,本文实现了双向选择性扫描以提高信道估计性能,因为不同子载波的信道增益是非因果的。此外,所提出的框架在空间复杂度上比基于Transformer的神经网络要低。在3GPP TS 36.101信道上的仿真结果表明,与其它基线神经网络解决方案相比,所提出的方法在减少可调参数数量的同时实现了改进的信道估计性能。

英文摘要

This paper proposes a hybrid Mamba-attention neural architecture to achieve improved channel estimation for orthogonal frequency-division multiplexing (OFDM) waveforms, particularly for configurations with a large number of subcarriers. By integrating a customized Mamba module, the proposed framework handles large-scale subcarrier channel estimation efficiently while capturing long-distance dependencies among these subcarriers effectively. Unlike the conventional Mamba structure, this paper implements a bidirectional selective scan to enable information propagation from both directions, because channel gains at different subcarriers are inherently non-causal. In addition, by integrating Mamba to reduce the reliance on quadratic-complexity self-attention, the proposed solution achieves lower space complexity than fully transformer architectures. Simulation results based on the 3GPP TS 36.101 channel demonstrate that compared to other baseline neural networks, the proposed method achieves superior channel estimation performance with fewer tunable parameters and exhibits good generalization across previously unseen channels.

URL PDF HTML 收藏
2607.16123 2026-07-20 cs.RO 新提交

BayesContact: Uncertain Pose Estimation via Visuo-Tactile Proposals and Simulation-based Inference

BayesContact:通过视觉触觉提议和基于模拟的推理进行不确定姿态估计

Aditya Kamireddypalli, Matias Mattamala, Joao Moura, Russell Buchanan, Sethu Vijayakumar, Subramanian Ramamoorthy

机构 * School of Informatics, University of Edinburgh(爱丁堡大学信息学院) Department of Mechanical and Mechatronics Engineering, University of Waterloo(滑铁卢大学机械与机电工程系)

AI总结 针对富含接触操作中姿态估计难题,提出BayesContact框架,通过融合视觉与触觉信息及基于模拟的推理来维护物体姿态信念,经模拟预测与真实观测对比更新信念,提升了姿态可观测性与插入成功率。

详情
AI中文摘要

富含接触的操作需要比仅深度感知提供的更准确的姿态估计。现有方法依赖视觉和接触,采用成本高昂的离线训练程序,且新环境和几何形状需重新训练。我们提出BayesContact,一种用于销孔插入中视觉触觉姿态估计的基于模拟的推理框架。它通过粒子信念维护物体姿态,融合深度观测与力/扭矩衍生的接触证据。利用基于模拟的前向模型近似观测似然性,通过渲染器预测深度测量值,物理模拟器预测受保护探测动作下的接触结果,并与真实观测进行评分以更新信念。生成的多模态信念还能实现基于信息增益的探测以进行主动消歧。在模拟几何形状和真实机器人实验中,BayesContact比仅视觉推理提高了30%的姿态可观测性和插入成功率。

英文摘要

Contact-rich manipulation requires pose estimates that are often more accurate than what depth-only sensing provides. Existing methods, relying on vision and contact, employ costly offline training procedures that need to be retrained for new environments and geometries. We propose BayesContact, a Simulation-Based Inference framework for visuo-tactile pose estimation in peg-in-hole insertion. BayesContact maintains a particle belief over object pose and fuses depth observations with force/torque-derived contact evidence. We employ simulation based forward models to approximate these observation likelihoods. For each pose hypothesis, a renderer predicts depth measurements and a physics simulator predicts contact outcomes under guarded probing actions; both are scored against real observations to update the belief. The resulting multimodal belief also enables information-gain-based probing for active disambiguation. Across simulated geometries and real-robot experiments, BayesContact improves pose observability and insertion success over vision-only inference by 30%

URL PDF HTML 收藏
2602.14656 2026-07-20 cs.LG math.DG math.OC 版本更新

An Embarrassingly Simple Way to Optimize Orthogonal Matrices at Scale

一种简单易行的方法用于大规模优化正交矩阵

Adrián Javaloy, Antonio Vergari

机构 * Institute for Machine Learning, University of Edinburgh, GB(机器学习研究所,爱丁堡大学)

AI总结 POGO是一种高效优化算法,通过简化方法在大规模问题中有效满足正交约束,提升优化性能。

Comments 24 pages, 10 figures, accepted at ICML 2026

详情
AI中文摘要

正交约束在鲁棒性和概率机器学习中普遍存在。不幸的是,当前的优化器计算成本高,无法扩展到有数百或数千个约束的问题。一个值得注意的例外是Landing算法(Ablin等人,2024),但该算法却以暂时放松正交性为代价。在本工作中,我们重新审视并改进了Landing背后的思路,使能够包含现代自适应优化器,同时确保正交约束得到有效满足。令人惊讶的是,这些改进几乎不增加成本,并减少了所需的超参数数量。我们的算法POGO速度快且适合GPU,仅包含5次矩阵乘法,在实践中始终保持正交性。在几个具有挑战性的基准测试中,POGO远超最近的优化器,并展示了它可以在几分钟内优化具有数千个正交矩阵的问题,而其他方法则需要数小时。因此,POGO为最终在大规模机器学习中利用正交约束树立了新的里程碑。POGO的PyTorch实现已公开在https://github.com/adrianjav/pogo。

英文摘要

Orthogonality constraints are ubiquitous in robust and probabilistic machine learning. Unfortunately, current optimizers are computationally expensive and do not scale to problems with hundreds or thousands of constraints. One notable exception is the Landing algorithm (Ablin et al., 2024) which, however comes at the expense of temporarily relaxing orthogonality. In this work, we revisit and improve on the ideas behind Landing, enabling the inclusion of modern adaptive optimizers while ensuring that orthogonal constraints are effectively met. Remarkably, these improvements come at little to no cost, and reduce the number of required hyperparemeters. Our algorithm POGO is fast and GPU-friendly, consisting of only 5 matrix products, and in practice maintains orthogonality at all times. On several challenging benchmarks, POGO greatly outperforms recent optimizers and shows it can optimize problems with thousands of orthogonal matrices in minutes while alternatives would take hours. As such, POGO sets a milestone to finally exploit orthogonality constraints in ML at scale. A PyTorch implementation of POGO is publicly available at https://github.com/adrianjav/pogo.

URL PDF HTML 收藏
2503.16592 2026-07-20 cs.RO 版本更新

ContactFusion: Stochastic Poisson Surface Maps from Visual and Contact Sensing

ContactFusion:基于视觉和接触传感的随机泊松曲面地图

Aditya Kamireddypalli, Joao Moura, Russell Buchanan, Matias Mattamala, Sethu Vijayakumar, Subramanian Ramamoorthy

机构 * School of Informatics, University of Edinburgh(信息学院,爱丁堡大学) Department of Mechanical and Mechatronics Engineering, University of Waterloo(机械与机电工程系,滑铁卢大学)

AI总结 研究针对机器人装配中场景理解噪声影响插入成功率的问题,提出ContactFusion方法,结合全局映射与局部接触信息,通过拒绝采样程序估计接触位置,将接触与视觉信息融合到SPSMap,验证了方法有效性并改善孔位估计。

Comments Version accepted to IROS2026

详情
AI中文摘要

稳健精确的机器人装配需要插入组成部件。当场景理解中的噪声超过容忍限度时,插入成功率会受到阻碍,尤其是在制造公差要求严格的情况下。在这项工作中,我们提出了ContactFusion,它将全局映射与局部接触信息相结合,融合点云与力传感。我们的方法需要基于拒绝采样的接触占用传感程序,从手腕处的力/扭矩传感估计末端执行器上的接触位置。我们展示了如何将接触与视觉信息融合到随机泊松曲面地图(SPSMap)中,该地图表示可以通过随机泊松曲面重建(SPSR)算法进行更新。我们首先在模拟中验证了接触占用传感器,并展示了其从力传感信息中检测机器人上接触位置的能力。然后,我们在插销入孔任务中评估了我们的方法,证明了将接触信息与SPSMap融合可改善孔位估计。

英文摘要

Robust and precise robotic assembly entails insertion of constituent components. Insertion success is hindered when noise in scene understanding exceeds tolerance limits, especially when fabricated with tight tolerances. In this work, we propose ContactFusion which combines global mapping with local contact information, fusing point clouds with force sensing. Our method entails a Rejection Sampling based contact occupancy sensing procedure which estimates contact locations on the end-effector from Force/Torque sensing at the wrist. We demonstrate how to fuse contact with visual information into a Stochastic Poisson Surface Map (SPSMap) - a map representation that can be updated with the Stochastic Poisson Surface Reconstruction (SPSR) algorithm. We first validate the contact occupancy sensor in simulation and show its ability to detect the contact location on the robot from force sensing information. Then, we evaluate our method in a peg-in-hole task, demonstrating an improvement in the hole pose estimate with the fusion of the contact information with the SPSMap.

URL PDF HTML 收藏
2607.13891 2026-07-17 cs.LG cs.CV eess.SP stat.ML 交叉投稿

PiVoT: A Variational Solution for Real-time Large-scale Multi-object Detection and Tracking under Heavy Clutter

PiVoT:一种用于在严重杂波下实时大规模多目标检测与跟踪的变分解决方案

Runze Gan, Qing Li, Simon J. Godsill, Mike E. Davies, James R. Hopgood

机构 * Institute for Imaging, Data and Communications (IDCOM), University of Edinburgh(爱丁堡大学成像、数据与通信研究所(IDCOM)) Department of Engineering, University of Cambridge(剑桥大学工程系) School of Mathematics, University of Edinburgh(爱丁堡大学数学学院)

AI总结 针对数据稀缺雷达应用中多目标检测跟踪难题,PiVoT通过联合推断目标多方面信息,无需外部聚类或检测器,利用变分推断创新实现快速抗杂波跟踪,实验证明其在多方面性能出色,优于现有贝叶斯跟踪器。

详情
AI中文摘要

在许多数据稀缺的雷达应用中,从噪声点云进行多目标检测和跟踪仍然具有挑战性。当前基于泊松测量模型的贝叶斯跟踪器提供了一种无需训练的解决方案,但在严重杂波、大量目标和全分辨率多普勒点云情况下,难以实现准确性和效率。我们使用PiVoT来解决这个问题,它是一种用于位置和多普勒测量的快速、抗杂波多目标跟踪器。PiVoT通过联合推断目标状态、形状、存在概率、数据关联和测量率,对大量且随时间变化的目标进行端到端检测和跟踪,无需外部聚类或检测器。其效率得益于多种变分推断创新,如理论上合理的出生剪枝算法、精确更新的二次到线性复杂度降低以及计算高效的多普勒泊松模型。实验表明,PiVoT在具有挑战性的场景中大大优于现有的贝叶斯跟踪器,同时还展示了对一千个目标的出色可扩展性、对与目标视觉上无法分离的杂波的鲁棒性,以及在全尺寸现代汽车雷达数据集上的实时操作能力,在无需训练的联合检测器和跟踪器方面,其性能可与深度学习检测基准相媲美。

英文摘要

Multi-object detection and tracking from noisy point clouds remain challenging in many data-scarce radar applications. Current Bayesian trackers based on Poisson measurement models offer a training-free solution but struggle to achieve accuracy and efficiency under severe clutter, large object populations, and full-resolution Doppler point clouds. We address this with PiVoT, a fast, clutter-resilient multi-object tracker for both positional and Doppler measurements. PiVoT performs end-to-end detection and tracking of a large and time-varying number of objects without external clustering or detectors, through joint inference of object states, shapes, existence probabilities, data association, and measurement rates. Its efficiency is driven by several variational inference innovations, such as theoretically justified birth pruning, quadratic-to-linear complexity reductions for exact updates, and a computationally efficient Doppler Poisson model. Experiments show that PiVoT substantially outperforms existing Bayesian trackers in challenging scenes, while also demonstrating exceptional scalability to a thousand objects, robustness to clutter visually inseparable from objects, and real-time operation on full-scale modern automotive radar datasets, where it attains performance comparable to a deep-learning detection benchmark as a training-free joint detector and tracker.

URL PDF HTML 收藏
2607.13643 2026-07-16 cs.LG cs.AI cs.CL 新提交

Consensus as Privileged Context for Label-Free Self-Distillation

作为无标签自蒸馏特权上下文的共识

John Gkountouras, Josip Jukić, Ivan Titov

机构 * ILLC, University of Amsterdam(逻辑、语言与计算研究所,阿姆斯特丹大学) ILCC, University of Edinburgh(信息实验室,爱丁堡大学)

AI总结 研究旨在提高无标签大语言模型推理准确性,提出CANON方法将共识转化为token级监督,通过采样多个解决方案并以达到多数答案的方案为条件设置模型快照来监督。实验表明该方法大幅提升性能,还能迁移,改进非单纯分布锐化。

详情
AI中文摘要

采样多个解决方案并返回多数答案是提高无标签大语言模型推理准确性的最可靠方法之一,越来越多的方法将这种共识信号转化为训练监督。然而,现有方法仅以受限形式使用共识。我们提出了CANON,一种无标签训练方法,将共识转化为密集的、token级监督。对于每个无标签提示,CANON采样多个解决方案,提取多数答案,并以达到该答案的解决方案为条件设置模型的冻结快照;然后这个基于共识的教师在每个token上监督模型自身的展开。在数学和科学推理基准上的实验表明,CANON将pass@1提高了多达12分,在计算量仅为无标签强化学习七分之一的情况下比其高出6分,接近基于正确答案训练的教师模型;在聚合无标签数据上训练后,它可迁移到保留基准上匹配使用正确标签的训练方法。分析表明这些改进并非纯粹的分布锐化:训练后,模型能解决之前32次尝试中都未解决的问题,且其多数投票本身也变得更准确。

英文摘要

Sampling multiple solutions and returning the majority answer is among the most reliable ways to improve the reasoning accuracy of large language models without labels, and a growing family of methods converts this consensus signal into training supervision. However, existing approaches use consensus only in restricted forms: as a filter that selects solutions for fine-tuning, as a preference between answers, or as a scalar reward for reinforcement learning, discarding most of the information that the agreeing solutions contain. We present CANON (Consensus-ANchored self-distillatiON), a label-free training method that turns consensus into dense, token-level supervision. For each unlabeled prompt, CANON samples multiple solutions, extracts the majority answer, and conditions a frozen snapshot of the model on a solution that reaches it; this consensus-anchored teacher then supervises the model on its own rollouts at every token. Experiments on mathematical and scientific reasoning benchmarks show that CANON improves pass@1 by up to 12 points, outperforming label-free reinforcement learning by 6 points at a seventh of its compute and approaching a teacher conditioned on gold solutions; trained on pooled unlabeled data, it transfers to held-out benchmarks, matching training methods that use gold labels. Analysis suggests that the improvements are not pure distribution sharpening: after training, the model solves problems it previously never solved in 32 attempts, and its majority vote itself becomes more accurate.

URL PDF HTML 收藏
2605.23045 2026-07-16 cs.CV cs.AI cs.LG 版本更新

The TIME Machine: On The Power of Motion for Efficient Perception

时间机器:论运动在高效感知中的力量

Mantas Skackauskas, Xinyue Hao, Laura Sevilla-Lara

机构 * School of Informatics University of Edinburgh(信息学院爱丁堡大学)

AI总结 提出以运动为核心模态的视频表示方法,通过点轨迹掩码自编码器自监督学习,大幅降低训练数据需求并提升时间理解能力。

Comments for project page, see https://time-model.github.io/

详情
AI中文摘要

近年来,视频表示学习取得了巨大进展。这受到多种因素的推动,包括训练规模以及通过语言对比训练的视觉模型的成功。虽然这些因素推动了视频模型的能力边界,但它们也引入了自身的局限性:首先,扩展视频模型可能达到高昂的成本;其次,从语言学习限制了可学习概念的范围,仅限于字幕中的概念。因此,视频模型在时间理解方面仍然存在困难。在本文中,我们提出了一种新颖的方法,将运动作为视频表示的核心模态。具体而言,给定视频中以点轨迹形式存在的运动,我们使用掩码自编码器来掩码部分轨迹,并训练自编码器重建缺失的轨迹。这使我们能够以自监督方式学习表示。我们表明,使用运动来表示视频实际上解决了视频技术的两个核心局限性。首先,它使我们能够大幅减少训练数据的规模,因为运动本质上与外观无关,因此需要更少的样本就能很好地泛化。其次,运动使我们能够绕过依赖语言的训练范式,学习更细粒度的概念。结果是一种嵌入,我们称之为TIME(时间感知运动嵌入),这是一种仅使用合成运动数据训练的表示。我们在零样本方式下对广泛的任务测试了这种嵌入。我们观察到,无需额外技巧,其性能与使用多达4个数量级更少训练数据的最先进模型相当。这为迈向更有时序感知且更具可扩展性的视频模型新范式奠定了基础。

英文摘要

Video representation learning has seen tremendous progress in recent years. This has been driven by many factors, including the scale of training and the success of visual models trained contrastively with language. While these factors have pushed the boundaries of what video models can do, they also introduce their own set of limitations: first, scaling video models can reach prohibitive costs and second, learning from language restricts the range of concepts that can be learned to those in captions. As a result, video models still struggle with temporal understanding. In this paper we propose a novel approach that uses motion as the central modality for video representation. In particular, given the motion in a video in the form of point-tracks, we use a masked-autoencoder to mask some of the tracks and train the autoencoder to reconstruct the missing tracks. This allows us to learn a representation in a self-supervised manner. We show that using motion to represent videos actually addresses both of the core limitations of video technology. First, it allows us to massively reduce the scale of training data, as motion is inherently appearance-independent and hence needs fewer examples to generalize well. Second, motion allows us to bypass the language-dependent training paradigm, learning better fine-grained concepts. The result is an embedding that we call TIME (Temporally Informed Motion Embedding), a representation trained exclusively on synthetic motion data. We test this embedding on a wide set of tasks in a zero-shot manner. We observe that without bells and whistles, performance is on par with state-of-the-art models using up to 4 orders of magnitude less training data. This is a stepping stone towards a new paradigm of video models that are both more temporally aware as well as more scalable.

URL PDF HTML 收藏
2605.18147 2026-07-16 cs.LG 版本更新

Foundation Models for Credit Risk Prediction: A Game Changer?

信贷风险预测的基础模型:变革性突破?

Bart Baesens, Andreas Goethals, Stefan Lessmann, Simon De Vos, Cristián Bravo, David Martens, Victor Medina-Olivares, Christophe Mues, Maria Oskarsdóttir, Seppe vanden Broucke, Tony Van Gestel, Tim Verdonck, Wouter Verbeke

机构 * Faculty of Economics and Business, KU Leuven, Belgium(比利时库勒万大学经济与商业学院) School of Business and Economics, Humboldt University of Berlin, Germany(德国洪堡大学商学院) Department of Statistical and Actuarial Sciences, Western University, Canada(加拿大西部大学统计与精算科学系) Department of Engineering Management, University of Antwerp, Belgium(比利时安特卫普大学工程管理系) Business School, University of Edinburgh, United Kingdom(英国爱丁堡大学商学院) Business School, University of Southampton, United Kingdom(英国南安普顿大学商学院) School of Mathematical Sciences, University of Southampton, United Kingdom(英国南安普顿大学数学科学学院) Department of Business Informatics and Operations Management, Ghent University, Belgium(比利时根特大学商业信息与运营管理系) Department of Mathematics, University of Antwerp, Belgium(比利时安特卫普大学数学系) Department of Mathematics, KU Leuven, Belgium(比利时库勒万大学数学系)

AI总结 本文研究了信贷风险预测中基础模型的应用,探讨了其在小数据环境下提升预测性能的能力,并通过对比多种方法验证了基础模型在PD和LGD建模任务中的优越性。

详情
AI中文摘要

预测模型在信贷风险管理中发挥着关键作用,通过准确估计违约概率和损失来指导关键决策。大量研究引入了新的建模技术,并通过大规模基准研究巩固了最先进的方法。如今,梯度提升模型配以SHAP解释器已成为准标准,但风险模型的持续改进仍是首要任务。同时,人工智能的快速进展,尤其是大型语言模型,已颠覆了预测建模范式。基础模型通过在广泛领域数据集上预训练,利用先验知识表现出色。尽管在自然语言处理和计算机视觉中广泛应用,但针对表格数据的基础模型才刚刚出现。我们推测,在小数据设置中,如中小企业贷款或专门化的公司投资组合中,使用非领域数据进行预训练可能特别有益,并可能帮助解决长期存在的挑战,包括低违约率投资组合和类别不平衡问题。本文将最近提出的方法与广泛竞争对手进行基准测试,包括已建立和先进的机器学习技术,在PD和LGD建模两个核心任务中进行评估。我们的评估涵盖了各种数据集、性能指标和实验条件。我们发现,表格基础模型在各种数据集和任务中表现最佳。此外,当数据集规模减小时,它们在预测性能上提供了显著改进。这些结果令人印象深刻,因为模型在即开即用的情况下进行测试,无需超参数调优,确保了易用性和降低了计算成本。

英文摘要

Predictive models play a pivotal role in credit risk management, guiding critical decisions through accurate estimation of default probabilities and losses. Extensive research has introduced new modeling techniques, complemented by large-scale benchmarking studies consolidating the state-of-the-art. Today, quasi-standards such as gradient-boosting models paired with SHAP explainers have emerged, yet continuous improvement of risk models remains a top priority. Concurrently, rapid advancements in AI, most notably large language models, have disrupted predictive modeling paradigms. Foundation models, pretrained on extensive datasets from diverse domains, have demonstrated remarkable performance by leveraging prior knowledge. While prevalent in natural language processing and computer vision, foundation models for tabular data have only recently emerged. We conjecture that pretraining on out-of-domain data is particularly beneficial in small-data settings, such as SME lending or specialized corporate portfolios, and may help address longstanding challenges including low default portfolios and class imbalance. This paper benchmarks recently proposed tabular foundation models against a broad set of competitors, including established and advanced machine learning techniques, across two core tasks: PD and LGD modeling. Our evaluation encompasses various datasets, performance indicators, and experimental conditions. We find that tabular foundation models generally perform best across datasets and tasks. Moreover, they offer significant improvement in predictive performance as dataset size shrinks. These results are remarkable given that the models are tested out-of-the-box, without hyperparameter tuning, ensuring ease of use and mitigating computational costs.

URL PDF HTML 收藏
2607.09798 2026-07-14 cs.LG cs.AI cs.NI 新提交

JEPA for AI-Native 6G: Predictive Representations and Open Challenges

用于人工智能原生6G的联合嵌入预测架构:预测表示与开放挑战

Sheikh Salman Hassan, Irshad A. Meer, Almoatssimbillah Saifaldawla, Yan Kyaw Tun, Mustafa Ozger, Madyan Alsenwi, Nguyen Van Huynh, Woong-Hee Lee, Cedomir Stefanovic, Mathini Sellathurai, Henk Wymeersch, Tharmalingam Ratnarajah

机构 * IDCoM, University of Edinburgh(爱丁堡大学IDCoM研究所) KTH Royal Institute of Technology(瑞典皇家理工学院) SnT, University of Luxembourg(卢森堡大学SnT) Department of Electronic Systems, Aalborg University(奥尔堡大学电子系统系) School of Computer Science and Informatics, University of Liverpool(利物浦大学计算机科学与信息学院) Division of Electronics and Electrical Engineering, Dongguk University(东国大学电子与电气工程系) School of Engineering and Physical Sciences, Heriot-Watt University(赫瑞瓦特大学工程与物理科学学院) Department of Electrical Engineering, Chalmers University of Technology(查尔姆斯理工大学电气工程系) Department of Electrical and Computer Engineering, San Diego State University(圣地亚哥州立大学电气与计算机工程系)

AI总结 本文围绕用于6G智能的联合嵌入预测架构(JEPA)展开。介绍其训练机制等,通过波束管理案例说明能提升标签效率与鲁棒性,还指出在多时间尺度预测等方面存在开放挑战。

Comments 14 pages, 4 figures, 3 tables. Tutorial and review on Joint-Embedding Predictive Architecture (JEPA) for AI-native 6G. Submitted to IEEE Communications Magazine

详情
AI中文摘要

第六代(6G)网络正朝着人工智能原生运行发展,学习模块嵌入于无线接入网(RAN)、边缘和核心。这种转变需要从有限标签、异构无线和网络数据、部分观测、非平稳传播以及延迟受限控制回路中学习。联合嵌入预测架构(JEPA)是适用于此场景的有前景的自监督范式,它在潜在空间预测缺失或未来表示。本文给出面向6G智能的JEPA无线导向教程。定义JEPA训练机制,描述如何对信道状态信息(CSI)、波束测量、关键性能指标(KPI)、拓扑图和传感观测进行令牌化和掩码处理,将学习到的编码器定位为用于RAN、O-RAN、边缘和核心功能的预测表示层。通过波束管理案例研究表明,无线感知目标能提高标签效率和鲁棒性。最后概述了多时间尺度预测、动作条件建模、分布式训练、可信度、高效部署、基准测试和标准化等开放挑战。

英文摘要

Sixth-generation (6G) networks are moving toward AI-native operation, where learning modules are embedded across the radio access network (RAN), edge, and core. This transition requires learning from limited labels, heterogeneous wireless and network data, partial observations, non-stationary propagation, and latency-constrained control loops. Joint-embedding predictive architecture (JEPA) is a promising self-supervised paradigm for this setting because it predicts missing or future representations in latent space instead of reconstructing raw measurements or using contrastive negative samples. This article presents a wireless-oriented tutorial on JEPA for 6G intelligence. We define the JEPA training mechanism, describe how CSI, beam measurements, KPIs, topology graphs, and sensing observations can be tokenized and masked, and position the learned encoder as a predictive representation layer for RAN, O-RAN, edge, and core functions, with task-specific heads or controllers producing final decisions. Then we present an illustrative, beam-management case study suggesting that a wireless-aware target, specifically an auxiliary future beam-energy target during self-supervised pretraining, can improve label efficiency and robustness across shifted deployment conditions relative to a supervised source domain. Finally, we outline open challenges in multi-timescale prediction, action-conditioned modeling, distributed training, trustworthiness, efficient deployment, benchmarking, and standardization.

URL PDF HTML 收藏
2607.03664 2026-07-14 cs.LG math.OC stat.ML 版本更新

A Structural Interpretation of GELU and Threshold-Transmission Activations via the First-Order Loss Function

通过一阶损失函数对GELU和阈值传输激活的结构解释

Roberto Rossi

机构 * Business School, University of Edinburgh(爱丁堡大学商学院)

AI总结 基于高斯互补一阶损失函数对GELU给出互补解释,将损失核算与前向信号传输分离,推广到阈值传输族,实验表明校准或学习的均匀阈值门有竞争力且能改进。

Comments 18 pages, 8 figures, 8 tables

详情
AI中文摘要

高斯误差线性单元通常被视为输入相关随机伯努利门的预期输出。本文基于高斯互补一阶损失函数给出一种互补解释:GELU是具有高斯随机阈值的硬线性门预期盈余的信号传输项。此观点推广到包括ReLU、GELU、SiLU/Swish和硬Swish的阈值传输族,实验表明校准或学习的均匀阈值门有竞争力且能改进。

英文摘要

The Gaussian Error Linear Unit is usually motivated as the expected output of an input-dependent Bernoulli gate. This work gives an alternative interpretation: GELU is the expected output of a hard linear gate with a Gaussian random threshold. This view provides a generative interpretation for the Bernoulli gate: the gate opens once the input clears a latent Gaussian threshold. This interpretation stems from a decomposition based on well-known results in stochastic inventory theory and leads to a threshold-transmission family that includes ReLU, GELU, SiLU/Swish, and hard swish as special cases. By considering a latent uniform threshold, we recover a hard-swish-like piecewise-polynomial gate whose nonlinear transition is confined to a finite interval, yielding fixed- and learned-width variants. Controlled experiments on compact vision and language models show that calibrated or learned uniform-threshold gates are consistently competitive with GELU, ReLU, and SiLU/Swish, improve over them in most tested settings, and use the finite transition region nontrivially.

URL PDF HTML 收藏
2508.21787 2026-07-14 cs.CL cs.AI 版本更新

PiCSAR: Probabilistic Confidence Selection And Ranking for Reasoning Chains

PiCSAR:基于推理链的概率置信度选择与排序

Joshua Ong Jun Leang, Zheng Zhao, Aryo Pradipta Gema, Sohee Yang, Wai-Chung Kwan, Xuanli He, Wenda Li, Pasquale Minervini, Eleonora Giunchiglia, Shay B. Cohen

机构 * Imperial College London(伦敦帝国学院) University of Edinburgh(爱丁堡大学) UCL(伦敦大学学院)

AI总结 PiCSAR通过联合对数似然度评估推理链和最终答案的置信度,无需训练即可提升大语言模型和推理模型的准确性,在多个基准测试中表现优异。

Journal ref Findings of the Association for Computational Linguistics: ACL 2026

详情
AI中文摘要

最佳n采样通过生成多个候选解并选择奖励最高的来提高大语言模型(LLMs)和大推理模型(LRMs)的准确性。在推理任务中,设计能识别正确推理链的评分函数是关键挑战。我们提出PiCSAR:一种简单、无需训练的方法,通过推理和最终答案的联合对数似然度评分候选生成。该联合对数似然度自然分解为推理置信度和答案置信度。PiCSAR在多个基准测试中取得显著提升(+10.18在MATH500,+9.81在AIME2025),在16/20次比较中优于基线,且使用至少2倍更少的样本。我们的分析表明,正确的推理链表现出显著更高的推理和答案置信度,证明了PiCSAR的有效性。

英文摘要

Best-of-n sampling improves the accuracy of large language models (LLMs) and large reasoning models (LRMs) by generating multiple candidate solutions and selecting the one with the highest reward. The key challenge for reasoning tasks is designing a scoring function that can identify correct reasoning chains without access to ground-truth answers. We propose Probabilistic Confidence Selection And Ranking (PiCSAR): a simple, training-free method that scores each candidate generation using the joint log-likelihood of the reasoning and final answer. The joint log-likelihood of the reasoning and final answer naturally decomposes into reasoning confidence and answer confidence. PiCSAR achieves substantial gains across diverse benchmarks (+10.18 on MATH500, +9.81 on AIME2025), outperforming baselines with at least 2x fewer samples in 16 out of 20 comparisons. Our analysis reveals that correct reasoning chains exhibit significantly higher reasoning and answer confidence, justifying the effectiveness of PiCSAR.

URL PDF HTML 收藏
2603.23750 2026-07-14 cs.CL 版本更新

IslamicMMLU: A Benchmark for Evaluating LLMs on Islamic Knowledge

伊斯兰MMLU:评估大语言模型在伊斯兰知识上的基准

Ali Abdelaal, Mohammed Nader Al Haffar, Mahmoud Fawzi, Walid Magdy

机构 * The University of Edinburgh(爱丁堡大学)

AI总结 伊斯兰MMLU基准通过10,013道题评估大语言模型在伊斯兰知识上的表现,涵盖《古兰经》、圣训和教法三个领域,测试模型在不同方面的能力,初步评估26个模型,准确率差异显著。

Comments Leaderboard link: https://huggingface.co/spaces/islamicmmlu/leaderboard

详情
AI中文摘要

大语言模型越来越多地被用于提供伊斯兰知识,但目前缺乏全面评估其在核心伊斯兰学科上性能的基准。我们介绍了伊斯兰MMLU基准,包含10,013道多选题,覆盖三个领域:《古兰经》(2,013题)、圣训(4,000题)和教法(4,000题)。每个领域包含多种类型的问题以测试LLM处理伊斯兰知识不同方面的能力。该基准用于创建伊斯兰MMLU公开排行榜以评估LLM,我们初步评估了26个LLM,其在三个领域的平均准确率从39.8%到93.8%(Gemini 3 Flash)。《古兰经》领域表现跨度最大(99.3%到32.4%),而教法领域包含一个新型madhab(伊斯兰法学派别)偏见检测任务,揭示了模型在不同法学派别偏好上的差异。阿拉伯语特定模型表现混合,但均不如前沿模型。评估代码和排行榜已公开发布。

英文摘要

Large language models are increasingly consulted for Islamic knowledge, yet no comprehensive benchmark evaluates their performance across core Islamic disciplines. We introduce IslamicMMLU, a benchmark of 10,013 multiple-choice questions spanning three tracks: Quran (2,013 questions), Hadith (4,000 questions), and Fiqh (jurisprudence, 4,000 questions). Each track is formed of multiple types of questions to examine LLMs capabilities handling different aspects of Islamic knowledge. The benchmark is used to create the IslamicMMLU public leaderboard for evaluating LLMs, and we initially evaluate 26 LLMs, where their averaged accuracy across the three tracks varied between 39.8% to 93.8% (by Gemini 3 Flash). The Quran track shows the widest span (99.3% to 32.4%), while the Fiqh track includes a novel madhab (Islamic school of jurisprudence) bias detection task revealing variable school-of-thought preferences across models. Arabic-specific models show mixed results, but they all underperform compared to frontier models. The evaluation code and leaderboard are made publicly available.

URL PDF HTML 收藏
2602.04272 2026-07-14 stat.CO cs.LG stat.ME 版本更新

Bures-Wasserstein Importance-Weighted Evidence Lower Bound: Exposition and Applications

布雷斯 - 瓦瑟斯坦重要性加权证据下界:阐述与应用

Peiwen Jiang, Takuo Matsubara, Minh-Ngoc Tran

机构 * The University of Sydney Business School(悉尼大学商学院) School of Mathematics, The University of Edinburgh(爱丁堡大学数学学院)

AI总结 研究在布雷斯 - 瓦瑟斯坦空间中优化重要性加权证据下界(IW - ELBO),推导其瓦瑟斯坦梯度并投影到该空间以用于高斯变分推理,证明其梯度估计器稳定性良好,实验显示该框架比其他基线有更优近似性能。

Comments 43 pages, 13 figures. Submitted to Bayesian Analysis

详情
AI中文摘要

重要性加权证据下界(IW - ELBO)已成为变分推理(VI)的有效目标,收紧了标准ELBO并减轻了寻模行为。然而,在欧几里得空间中优化IW - ELBO通常效率低下,因为其梯度估计器存在信噪比(SNR)消失的问题。本文在配备2 - 瓦瑟斯坦度量的高斯分布流形布雷斯 - 瓦瑟斯坦空间中制定了IW - ELBO的优化方法。我们推导了IW - ELBO的瓦瑟斯坦梯度并将其投影到布雷斯 - 瓦瑟斯坦空间,以产生用于高斯VI的可处理算法。我们分析的关键贡献涉及梯度估计器的稳定性。虽然标准欧几里得梯度估计器的SNR会随着重要性样本数量$K$的增加而消失,但我们证明瓦瑟斯坦梯度的SNR按$\Omega(\sqrt{K})$的比例良好缩放,即使对于大$K$也能确保优化效率。我们进一步将这种几何分析扩展到变分雷尼重要性加权自动编码器界,建立了类似的稳定性保证。实验表明,与其他基线相比,所提出的框架实现了卓越的近似性能。

英文摘要

The Importance-Weighted Evidence Lower Bound (IW-ELBO) has emerged as an effective objective for variational inference (VI), tightening the standard ELBO and mitigating the mode-seeking behaviour. However, optimizing the IW-ELBO in Euclidean space is often inefficient, as its gradient estimators suffer from a vanishing signal-to-noise ratio (SNR). This paper formulates the optimisation of the IW-ELBO in Bures-Wasserstein space, a manifold of Gaussian distributions equipped with the 2-Wasserstein metric. We derive the Wasserstein gradient of the IW-ELBO and project it onto the Bures-Wasserstein space to yield a tractable algorithm for Gaussian VI. A pivotal contribution of our analysis concerns the stability of the gradient estimator. While the SNR of the standard Euclidean gradient estimator is known to vanish as the number of importance samples $K$ increases, we prove that the SNR of the Wasserstein gradient scales favourably as $Ω(\sqrt{K})$, ensuring optimisation efficiency even for large $K$. We further extend this geometric analysis to the Variational Rényi Importance-Weighted Autoencoder bound, establishing analogous stability guarantees. Experiments demonstrate that the proposed framework achieves superior approximation performance compared to other baselines.

URL PDF HTML 收藏
2602.20064 2026-07-13 cs.PL cs.AI cs.CR 版本更新

The LLMbda Calculus: AI Agents, Conversations, and Information Flow

LLMlambda 计算:人工智能代理、对话与信息流

Zac Garby, Andrew D. Gordon, David Sands

机构 * University of Nottingham, UK(诺丁汉大学) University of Edinburgh, UK(爱丁堡大学) Chalmers University of Technology(查尔姆斯理工大学) The University of Gothenburg, Sweden(哥德堡大学)

AI总结 本文提出了一种无类型的lambda计算模型,用于形式化描述和验证人工智能代理中对话和信息流的安全性。

详情
AI中文摘要

与大型语言模型(LLM)的对话是一系列提示和响应的序列,每个响应都是从先前对话中生成的。人工智能代理自动构建此类对话:给定一个初始人类提示,规划循环会交错调用LLM和工具调用以及代码执行。这种紧密耦合创建了一个新且不为人知的攻击面。恶意提示注入到对话中可能会破坏后续推理,触发危险的工具调用,或扭曲最终输出。尽管这些系统至关重要,但我们目前缺乏一个原则性的语义基础来推理其行为和安全性。我们通过引入一种无类型的按值lambda计算,其包含动态信息流控制和少量用于构建提示-响应对话的基本原理来解决这一差距。我们的语言包含一个基本原理用于调用LLM:它将值序列化,将其发送给模型作为提示,并将响应解析为新的术语。该语言忠实表示规划循环及其漏洞,包括提示注入如何改变后续计算的机制。语义明确捕捉对话,因此支持推理关于防御措施,如隔离的子对话、生成代码的隔离以及信息流限制对LLM调用的影响。一个不关心终止的非干扰定理确立了完整性和保密性保证,证明了一个形式化计算可以为安全代理编程提供严谨的基础。

英文摘要

Large language models are increasingly deployed as agents: they plan, call tools, read untrusted data, and act on the results. This exposes them to prompt injection: data meant only to be read is obeyed as an instruction. The most principled defences replace content inspection with provenance: classifying data by source and keeping trusted and untrusted apart through a separation of duty (the dual-LLM pattern) and information-flow control. Yet the leading systems are hard to fully trust: flow tracking is easy to get wrong, deliberate relaxations are hard to audit, and the dual-LLM pattern is hard-wired into the architecture. We present LLMbda, an untyped call-by-value lambda calculus that makes provenance-based defence both expressible and provably sound, without committing to an architecture. It adds the operational core of agentic systems as first-class constructs: prompt-response conversations that can be forked and cleared, code generation, and dynamic information-flow control in which every value carries a label that every reduction propagates. Isolation becomes a policy a program expresses, and reclassification an explicit, auditable construct. Our central result is a termination-insensitive probabilistic noninterference theorem over the whole calculus, including code-generating agents, with an insulated variant that holds even when the attacker chooses all untrusted inputs. The verified interpreter is itself the harness that calls the model, to our knowledge the first LLM agent harness whose executable is the subject of machine-checked security theorems, so every agent inherits the guarantee. On the AgentDojo banking benchmark, an agent built within LLMbda, enforcement always on, matches the utility of CaMeL, a leading dual-LLM defence, run without its policy checks (which halve its utility), and resists all but two of 1296 attacked runs. Our harness and all proofs are in Lean.

URL PDF HTML 收藏
2607.06855 2026-07-09 cs.LG cs.CL 新提交

Geometric Self-Distillation for Reasoning Generalization

用于推理泛化的几何自蒸馏

Josip Jukić, Ivan Titov

机构 * ILLC, University of Amsterdam(阿姆斯特丹大学伊利沙伯格学院) ILCC, University of Edinburgh(爱丁堡大学伊利沙伯格中心)

AI总结 研究针对大语言模型特权上下文自蒸馏中监督难以信赖、导致分布外推理能力下降的问题,提出几何自蒸馏目标GeoSD,通过Hellinger损失和近端项对抗漂移,提升了模型分布外推理准确率。

详情
AI中文摘要

策略内蒸馏是大语言模型实用的训练后方法,为学生模型自身轨迹提供密集教师监督。在特权上下文自蒸馏中,教师和学生是基于相同前缀的同一模型,但教师还能看到提示或完整求解轨迹。这使得监督丰富但难以信赖:教师对特权视角下明显的延续有信心,但学生无法证明其合理性。蒸馏拉力在教师和学生分歧最大处最强,多次更新后会累积成漂移,降低分布外(OOD)推理能力。我们引入了GeoSD,一种几何自蒸馏目标,将这种漂移视为学生预测行为中的移动,并以两种互补方式对抗它。一个Hellinger损失根据学生已有的重叠部分来缩放每个教师偏好,减弱对学生尚无法支持的token的拉力。由于这些拉力在训练中仍会累积,一个近端项会惩罚学生预测与最近检查点的漂移程度,以Fisher-Rao距离衡量。两者都是在下一个token分布的同一几何结构中的距离,自然梯度更新在该几何结构中而不是参数空间中进行步长更新。在数学推理基准和三个模型系列中,GeoSD在保持自蒸馏的分布内收益的同时,相对于基础模型将平均OOD准确率提高了5.7 - 8.6个百分点,且在从1.7B到32B的模型规模上都有提升。分析标准匹配在分布外失败的原因,我们发现它通过从高熵状态的替代方案中抽取质量来赢得与教师的一致,导致对错误答案的自信一致,而GeoSD则使这些替代方案仍可触及。

英文摘要

On-policy distillation is a practical post-training recipe for large language models, supplying dense teacher supervision on the student's own trajectories. In privileged-context self-distillation, teacher and student are the same model conditioned on the same prefix, but the teacher also sees a hint or the full solution trace. This makes supervision abundant but harder to trust: the teacher can be confident about continuations its privileged view makes obvious but the student cannot yet justify. The distillation pull is strongest where teacher and student disagree most, and over many updates it accumulates into drift that degrades out-of-distribution (OOD) reasoning. We introduce GeoSD, a geometric self-distillation objective that treats this drift as movement in the student's predictive behavior and counters it in two complementary ways. A Hellinger loss scales each teacher preference by the overlap the student already shares with it, attenuating the pull on tokens the student cannot yet support. Since these pulls still compound over training, a proximal term penalizes how far the student's predictions drift from a recent checkpoint, measured as a Fisher-Rao distance. Both are distances in the same geometry of next-token distributions, and a natural-gradient update takes its steps in that geometry rather than in parameter space. Across mathematical reasoning benchmarks and three model families, GeoSD preserves the in-distribution gains of self-distillation while improving average OOD accuracy by 5.7-8.6 points over the base model, with gains holding across model scales from 1.7B to 32B. Analyzing why standard matching fails out of distribution, we find it wins agreement with the teacher by draining mass from alternatives at high-entropy states, resulting in confident agreement on wrong answers, whereas GeoSD keeps those alternatives in reach.

URL PDF HTML 收藏
2606.29251 2026-07-09 cs.AI q-fin.CP 版本更新

When Summaries Distort Decisions: Information Fidelity in LLM-Compressed Financial Analysis

当摘要扭曲决策:LLM压缩财务分析中的信息保真度

Hoyoung Lee, Suhwan Park, Seunghan Lee, Jun Seo, Jaehoon Lee, Sungdong Yoo, Minjae Kim, CheolWon Na, Zhangyang Wang, Zach Golkhou, Minkyu Kim, Sotirios Sabanis, Alejandro Lopez-Lira, Dhagash Mehta, Soonyoung Lee, Chanyeol Choi, Wonbin Ahn, Yongjae Lee

机构 * UNIST(全纳科学技术大学) LG AI Research(LG人工智能研究) Sungkyunkwan University(成均馆大学) University of Texas at Austin(德克萨斯大学奥斯汀分校) J.P. Morgan Chase(摩根大通) State Street(州立银行) University of Edinburgh(爱丁堡大学) University of Florida(佛罗里达大学) BlackRock(黑石) LinqAlpha

AI总结 研究LLM压缩财务信息时因丢失决策相关上下文导致投资判断改变的问题,提出通过生成多个候选压缩并审计分歧的代理上下文压缩方法。

Comments Preprint

详情
AI中文摘要

财务决策者面临的信息量远超其直接审查能力,因此需要进行上下文压缩。然而,当大型语言模型(LLM)压缩财务源材料时,它们可能会改变原始源所支持的投资判断。我们将此问题定义为信息保真度:当压缩改变源材料所引发的决策时,压缩就会失去保真度。在代理系统中,这种损失可能在中间步骤中重复出现,并在整个决策过程中放大。通过对财务申报文件和财报电话会议记录的分析,我们发现基于LLM的压缩可以生成流畅且事实合理的压缩上下文,但仍会改变下游决策。我们分析了与保真度损失相关的两种诊断模式:去语境化,即保留显著证据但将其与正确解释所需的警示和语境限定词分离;以及模型依赖性,即不同的压缩器对同一源材料呈现不同的视角。然后,我们提出了代理上下文压缩,该方法生成多个候选压缩并审计它们与原始源材料的分歧。我们的结果表明,财务压缩不仅应根据效率或事实性进行评估,还应根据其保留决策相关上下文的能力进行评估。

英文摘要

Financial decision-makers face more information than they can directly inspect, making context compression necessary. Yet when large language models (LLMs) compress financial source material, they can alter the investment judgment supported by the original source. We frame this problem as information fidelity: compression loses fidelity when it changes the decision induced by the source. In agentic systems, such losses may recur across intermediate steps and amplify throughout the decision process. Across financial filings and earnings-call transcripts, we find that LLM-based compression can produce fluent and factually plausible compressed contexts that nevertheless alter downstream decisions. We analyze two diagnostic patterns associated with fidelity loss: decontextualization, where salient evidence is retained but separated from the caveats and contextual qualifiers needed for correct interpretation, and model dependency, where different compressors expose different views of the same source. We then propose Agentic Context Compression, which generates multiple candidate compressions and audits their disagreements against the original source. Our results suggest that financial compression should be evaluated not only by efficiency or factuality, but also by its ability to preserve decision-relevant context.

URL PDF HTML 收藏
2607.06388 2026-07-08 cs.RO cs.CV cs.LG 新提交

Learning to Throw Objects Safely in Multi-Obstacle Environments

学习在多障碍物环境中安全投掷物体

Mohammadreza Kasaei, Klemen Voncina, Hamidreza Kasaei

机构 * University of Groningen(格罗宁根大学) University of Edinburgh(爱丁堡大学)

AI总结 研究在多障碍物环境中安全投掷物体的问题,引入势场状态表示,结合动觉演示初始化,用SAC等算法优化,经模拟和真实机器人实验,该表示在成功率和扩展性上表现出色,实现了模拟到真实的可靠迁移。

Comments This paper has been presented at the IEEE International Conference on Robotics & Automation (ICRA), 2026

详情
AI中文摘要

机器人投掷能够在机器人的直接工作空间之外快速有效地放置物体,但在杂乱环境中的可靠投掷仍未得到充分探索。现有方法,如TossingBot,从视觉输入中学习投掷策略,但假设环境无障碍物。本文解决了在场景中随机放置障碍物的情况下将物体投掷到目标篮筐的问题。我们引入了一种势场状态表示,它在固定大小的网格上紧凑地编码篮筐吸引力和障碍物排斥力,使强化学习(RL)策略能够在任意数量和配置的障碍物中进行泛化。该策略从动觉演示初始化,并使用三种先进的RL算法(SAC、DDPG、TD3)在模拟中进行优化。其中,SAC在各种场景中实现了最一致的性能。我们将势场表示与显式状态编码进行比较,证明它具有更高的成功率和对未见障碍物配置的更好扩展性。使用未见可投掷物体的真实机器人实验证实了强大的模拟到真实的迁移能力,在杂乱场景中成功率高达90%。这些结果表明,PFR为非结构化环境中安全高效的机器人投掷提供了一种实用且强大的表示。

英文摘要

Robotic throwing enables fast and efficient object placement beyond the robot's immediate workspace, but reliable throwing in cluttered environments remains underexplored. Existing approaches, such as TossingBot, learn throwing strategies from visual input but assume obstacle-free settings. In this paper, we address the problem of throwing objects into a target basket while avoiding obstacles placed randomly in the scene. We introduce a potential field state representation that compactly encodes both basket attraction and obstacle repulsion on a fixed-size grid, enabling reinforcement learning (RL) policies to generalize across arbitrary numbers and configurations of obstacles. The policy is initialized from kinesthetic demonstrations and optimized in simulation using three state-of-the-art RL algorithms (SAC, DDPG, TD3). Among these, SAC achieves the most consistent performance across scenarios. We compare the potential field representation against explicit state encodings and demonstrate that it achieves higher success rates and better scalability to unseen obstacle configurations. Real-robot experiments with unseen throwable objects confirm robust sim-to-real transfer, achieving up to $90\%$ success in cluttered scenes. These results demonstrate that PFR provides a practical and robust representation for safe and efficient robotic throwing in unstructured environments. A video showcasing our experiments is available at: https://youtu.be/ZZnJf8ua2dE

URL PDF HTML 收藏
2607.06262 2026-07-08 cs.RO 新提交

Optimal Transport Q-Learning for Flow Policy Steering and Acceleration

用于流策略引导和加速的最优传输Q学习

Andreas Sochopoulos, Esmeralda S. Whitammer, Nikolaos Tsagkas, João Moura, Michael Gienger, Sethu Vijayakumar

机构 * University of Edinburgh(爱丁堡大学) Honda Research Institute Europe(本田欧洲研究院)

AI总结 针对流策略性能优化难题,提出最优传输Q学习(OTQL),利用机器人经验,通过优势加权条件最优传输流匹配微调加速流策略,提升单任务和VLA策略成功率,减少推理步骤数。

详情
AI中文摘要

扩散和流策略最近在机器人应用中通过准确捕捉多模态机器人轨迹分布展现出卓越性能,特别是在视觉语言动作(VLA)模型中。然而,高质量策略性能还需快速推理和高质量演示,这往往难以实现,导致策略行为次优及分布转移时失败。本文通过强化学习后训练,利用机器人经验解决微调并加速次优流策略的问题。引入最优传输Q学习(OTQL),通过优势加权条件最优传输流匹配微调流策略。OTQL能在50 - 60轮交互预算下微调并加速流,避免模拟和实际机器人任务中计算昂贵的蒸馏。结果表明,OTQL利用机器人自身经验对流策略进行后训练,将单任务策略平均成功率从36%提高到86%,预训练VLA从38%提高到76%,同时将每个动作生成的推理步骤数减少70%。

英文摘要

Diffusion and flow policies have recently demonstrated remarkable performance in robotic applications by accurately capturing multimodal robot trajectory distributions, especially in the context of vision language action (VLA) models. However, high quality policy performance also requires fast inference and high quality demonstrations, which are often hard to get. Lack of these leads to suboptimal policy behaviors and failure under distribution shifts. In this work we address the problem of fine-tuning and accelerating suboptimal flow-based policies using the robot's experience through RL post-training. We introduce Optimal Transport Q-Learning (OTQL), a new method for finetuning flow policies using advantage weighted conditional optimal transport flow matching. OTQL can finetune and accelerate flows with an interaction budget of 50-60 episodes while avoiding computationally expensive distillation in simulation and real-world robot tasks. Our results show that OTQL post-trains flow policies using the robot's own experience, increasing average success percentage of single-task policies from 36% to 86% and of a pre-trained VLA from 38% to 76% while reducing the number of inference steps per action generation by 70%.

URL PDF HTML 收藏
2606.02101 2026-07-08 stat.ML cs.LG stat.AP 版本更新

It does what it says on the tin: safe synthetic data from coarsened margins

名副其实:来自粗化边际的安全合成数据

Gillian M Raab

机构 * University of Edinburgh(爱丁堡大学) Scottish Centre for Administrative Data Research(苏格兰行政数据研究中心)

AI总结 提出一种通过粗化边际并应用迭代比例拟合算法生成合成数据的方法,确保透明性和无披露风险。

详情
AI中文摘要

本文提出了一种创建合成数据的方法,与当前可用的其他方法相比,该方法对用户有两个重要优势。首先是透明性;与其他方法不同,接收合成数据的人将知道原始数据中哪些变量之间的关系将在合成数据中大致保持。其次是保证合成数据来源于已被判定无披露风险的信息。这是通过首先定义和计算将在合成数据中保持变量关系的边际来实现的。然后,每个边际将根据数据保管者定义的标准进行统计披露控制,例如顶部编码和底部编码、小类别的组合和/或修改小计数。建议通过将表格中的所有计数粗化为披露限制的倍数来进一步调整策展边际。这些调整后的边际用于通过迭代比例拟合算法生成合成数据。使用1901年苏格兰人口普查的数据说明了创建此类合成数据的实际步骤。

英文摘要

This paper proposes a method of creating synthetic data (SD) that will have two important advantages for the user compared to other methods currently available. The first is transparency; unlike other methods, the person in receipt of the SD will know which of the relationships between variables in the original data will be approximately maintained in the SD. The second is a guarantee that the SD is derived from information that has already been judged to be free of disclosure risk. This is achieved by first defining and calculating the margins where relationships between variables will be maintained in the SD. Each margin will then be subject to statistical disclosure control (SDC) to the standards defined by the data custodian, e.g. top-coding and bottom-coding, combination of small categories and/or modifying small counts. Further adjustment of the curated margins is advised by coarsening all counts in the table to multiples of the disclosure limit. These adjusted margins are used to create SD by the Iterative Proportional Fitting (IPF) algorithm. The practical steps involved in creating such SD are illustrated using data from the 1901 Census of Scotland.

URL PDF HTML 收藏
2504.05294 2026-07-08 cs.CL 版本更新

Truthful or Fabricated? Using Causal Attribution to Mitigate Reward Hacking in Explanations

真实还是编造?利用因果归因减轻解释中的奖励作弊

Pedro Ferreira, Wilker Aziz, Ivan Titov

机构 * Institute for Logic, Language and Computation (ILLC), University of Amsterdam(逻辑、语言与计算研究所(ILLC),阿姆斯特丹大学) Institute for Language, Cognition and Computation (ILCC), University of Edinburgh(语言、认知与计算研究所(ILCC),爱丁堡大学)

AI总结 研究大语言模型解释中因奖励模型导致的奖励作弊问题,提出用预测的因果归因丰富奖励模型输入的方法,该方法能减少大语言模型生成误导性解释的倾向,提升解释忠实度。

Comments ICLR 2026 Camera-ready

详情
AI中文摘要

思维链解释被广泛用于检查大语言模型(LLMs)的决策过程并评估模型输出的可信度,对LLMs与人类的有效协作很重要。我们证明,对齐阶段的关键步骤偏好优化可能会无意中降低这些解释的忠实度。这是因为指导对齐的奖励模型(RM)既要优化响应的预期质量,又要优化解释的适当性,从而产生潜在冲突。RM缺乏评估模型内部决策过程与生成的解释之间一致性的机制。因此,LLM可能会进行“奖励作弊”。为解决此问题,我们建议用预测的因果归因丰富RM的输入,使RM能够检测生成的自解释与模型决策过程之间的差异。在受控设置中,我们表明这种方法减少了LLM生成误导性解释的倾向。

英文摘要

Chain-of-thought explanations are widely used to inspect the decision process of large language models (LLMs) and to evaluate the trustworthiness of model outputs, making them important for effective collaboration between LLMs and humans. We demonstrate that preference optimization - a key step in the alignment phase - can inadvertently reduce the faithfulness of these explanations. This occurs because the reward model (RM), which guides alignment, is tasked with optimizing both the expected quality of the response and the appropriateness of the explanations (e.g., minimizing bias or adhering to safety standards), creating potential conflicts. The RM lacks a mechanism to assess the consistency between the model's internal decision process and the generated explanation. Consequently, the LLM may engage in "reward hacking" by producing a final response that scores highly while giving an explanation tailored to maximize reward rather than accurately reflecting its reasoning. To address this issue, we propose enriching the RM's input with a causal attribution of the prediction, allowing the RM to detect discrepancies between the generated self-explanation and the model's decision process. In controlled settings, we show that this approach reduces the tendency of the LLM to generate misleading explanations.

URL PDF HTML 收藏
2607.05162 2026-07-07 cs.RO 新提交

Geometry-Aware Visual Odometry for Bronchoscopic Navigation via High-Gain Observer Fusion

基于高增益观测器融合的支气管镜导航几何感知视觉里程计

Mohammadreza Kasaei, Francis Xiatian Zhang, Feng Li, Farshid Alambeigi, Kevin Dhaliwal, Mohsen Khadem

机构 * School of Informatics, University of Edinburgh, UK(爱丁堡大学信息学院,英国)

AI总结 针对支气管镜视觉导航在纹理缺失气道中易漂移失效的问题,提出融合气道消失点线索与高增益观测器的几何感知VO,大幅降低轨迹误差,性能优于现有主流方案。

详情
AI中文摘要

导航支气管镜是肺部介入手术的关键技术,但现有平台高度依赖术前CT或外部传感器,限制了其在重症监护及资源受限场景中的应用。纯视觉导航提供了可扩展的替代方案,但传统视觉里程计(VO)难以应对纹理匮乏的气道图像、镜面反射以及管状解剖结构的消失点奇异性问题,频繁出现跟踪失效与漂移。本文提出一种几何感知VO框架,可显式利用气道管腔的消失点线索:将检测到的管腔反向投影为3D射线,通过加权融合在无视差线索的情况下仍可输出稳定的前进航向;该航向与基于逼近效应的速度估计一同通过定制高增益观测器与带噪声的VO输出融合,该观测器可强制遵循气道先验并抑制漂移。我们在配备电磁跟踪真值的离体机械通气人肺上对该方法进行了验证,与ORB-SLAM2、LoFTR-VO、DPVO等现有最优流水线相比,本方法将绝对轨迹误差降低了50%以上,在所有测试序列中均取得最低的相对位姿误差。

英文摘要

Navigational bronchoscopy is critical for pulmonary interventions, yet current platforms depend heavily on pre-operative CT or external sensors, limiting their use in critical care and resource-constrained settings. Vision-only navigation offers a scalable alternative, but conventional visual odometry (VO) struggles with texture-poor airway images, specularities, and the vanishing-point singularities of tubular anatomy, leading to frequent tracking failures and drift. We present a geometry-aware VO framework that explicitly leverages vanishing-point cues from airway lumens. Detected lumens are back-projected to 3D rays, whose weighted fusion yields a stable forward heading even when parallax cues are absent. This heading, together with looming-based velocity estimates, is fused with noisy VO outputs using a bespoke high-gain observer that enforces airway-following priors and rejects drift. We validate the method on ex-vivo mechanically ventilated human lungs with electromagnetic tracking ground truth. Compared to state-of-the-art pipelines (ORB-SLAM2, LoFTR-VO, DPVO), our approach reduces absolute trajectory error by more than 50% and achieves the lowest relative pose error across all test sequences.

URL PDF HTML 收藏
2607.04820 2026-07-07 cs.LG 新提交

KinEMbed: Decoding Kinematics from Electromyography via Cross-Modal Contrastive Learning

KinEMbed:通过跨模态对比学习从肌电图中解码运动学

Sofia Gilardini, Chenfei Ma, Kianoush Nazarpour

机构 * Department of Statistics, University of Oxford(牛津大学统计学系) School of Informatics, University of Edinburgh(爱丁堡大学信息学院)

AI总结 研究从表面肌电图解码手部运动学这一挑战,提出跨模态对比学习框架KinEMbed训练双编码器,用于手部运动学回归,在NinaPro DB8数据集上优于基线方法。

Comments ICML 2026 Workshop on Structured Data for Health, Seoul, South Korea

详情
AI中文摘要

从表面肌电图(EMG)中解码手部运动学是可穿戴生物信号处理中的核心挑战,与假肢控制和运动康复相关。大多数EMG表示学习方法专注于离散手势分类,很少关注连续回归。我们提出了KinEMbed,一种用于手部运动学回归的跨模态对比学习框架,它联合训练双编码器——一个用于窗口化EMG特征,一个用于运动学(关节角度)目标。由此产生的嵌入继承了运动学空间的几何结构,在推理时不需要运动学信号。在包括健全用户和肢体差异受试者(N = 11)的NinaPro DB8数据集上进行评估,KinEMbed在保留会话上优于PCA、PLS、自动编码器和对比(CEBRA)基线,在最具挑战性的拇指关节角度上增益最大。我们将这项工作定位为从结构化可穿戴生物信号中进行手部运动学回归的对比表示学习的第一步。

英文摘要

Decoding hand kinematics from surface electromyography (EMG) is a core challenge in wearable biosignal processing with clinical relevance for prosthetic control and motor rehabilitation. Most representation learning approaches for EMG focus on discrete gesture classification, and few focus on continuous regression. We present KinEMbed, a cross-modal contrastive learning framework for hand kinematics regression that jointly trains dual encoders -- one for windowed EMG features and one for kinematic (joint angle) targets. The resulting embeddings inherit the geometric structure of the kinematic space without requiring kinematic signals at inference time. Evaluating on the NinaPro DB8 dataset that includes both able-bodied users and subjects with limb difference (N=11), KinEMbed outperforms PCA, PLS, autoencoder and contrastive (CEBRA) baselines on held-out sessions, with largest gains on the most challenging thumb degrees of articulation. We position this work as a first step toward contrastive representation learning for regression of hand kinematics from structured wearable biosignals.

URL PDF HTML 收藏
2607.03934 2026-07-07 cs.CV 新提交

EgoInertia-MI: A Multimodal Egocentric Vision and IMU Benchmark for Motor Impairment Assessment

EgoInertia-MI:用于运动障碍评估的多模态自我中心视觉与惯性测量单元基准测试

Fatemah Alhamdoosh, Pietro Pala, Abduallah Mohamed, DK Arvind

机构 * University of Florence(佛罗伦萨大学) Meta Reality Labs(元现实实验室) University of Edinburgh(爱丁堡大学)

AI总结 研究针对运动障碍评估,结合自我中心视觉与惯性测量单元信号创建EgoInertia-MI数据集,设动作识别等任务并评估基线,发现多模态融合性能最佳,凸显两者结合用于运动评估的潜力。

详情
AI中文摘要

运动障碍在多种疾病中常见,传统评估有局限。可穿戴IMU和第三人视角视频有问题,自我中心视觉是更优选择。本文介绍EgoInertia-MI数据集,含健康志愿者模拟不同程度运动障碍的活动。建立两项基准任务并评估基线,结果表明自我中心视频对评估有重要线索,多模态融合性能最佳。

英文摘要

Motor impairments, including tremor, bradykinesia, gait abnormalities, and postural instability, are common across many neurological and movement-related conditions. Conventional clinical assessments are often intermittent and may fail to capture subtle temporal variations in motor behavior. While wearable IMUs and third-person video have shown promise for objective motor assessment, third-person recordings raise privacy concerns and require constrained acquisition setups. In contrast, egocentric vision provides a more naturalistic and privacyaware alternative. In this work, we introduce EgoInertia-MI, a multimodal benchmark dataset combining synchronized egocentric video and wearable IMU signals for motor impairment analysis. The dataset contains 19 upper- and lower-body activities performed by healthy volunteers simulating varying levels of motor impairment severity levels: no impairment, mild impairment, and severe impairment. We establish two benchmark tasks: action recognition and motor impairment severity estimation, and evaluate multiple unimodal and multimodal baselines. Experimental results show that egocentric video provides strong cues for motor impairment assessment, while multimodal fusion achieves the best overall performance, reaching 0.78 Macro-F1 for severity estimation and 0.93 Macro-F1 for action recognition. These findings highlight the potential of combining egocentric vision and wearable sensing for ecologically valid and privacy-aware motor assessment. Code and data are available at:https://fatemah-alh.github.io/EgoInertia-MI-Page/.

URL PDF HTML 收藏
2607.03891 2026-07-07 cs.CV 新提交

BAT3R: Bootstrapping Articulated 3D Reconstruction from 2D Image Collections

BAT3R:从二维图像集合中自训练关节式三维重建

Jakub Zadrozny, Oisin Mac Aodha, Hakan Bilen

机构 * University of Edinburgh(爱丁堡大学)

AI总结 研究从单张图像进行关节物体3D重建,利用未标注2D图像集和单个绑定规范网格,提出训练框架,通过拟合网格到预测点图迭代估计关节和相机姿态,提升模型性能。

Comments Accepted to ECCV 2026. Project page: https://jakubzadrozny.github.io/bat3r/

详情
AI中文摘要

从单张图像进行关节物体的3D重建具有挑战性,因为难以获得带配对图像和3D监督的大型训练数据集。近期基于点图的方法依赖人工创建的带精心策划姿态分布的关节3D资产渲染的合成数据集。我们提出一个训练框架,通过利用每个类别只有一个绑定规范网格的未标注2D图像集来减少这一需求。

英文摘要

3D reconstruction of articulated objects from a single image is challenging because large training datasets with paired image and 3D supervision are difficult to obtain. Recent point map-based methods achieve strong performance but rely on synthetic datasets rendered from manually created articulated 3D assets with carefully curated pose distributions. While camera viewpoints can be easily sampled, generating realistic object articulations remains costly and labor-intensive. We propose a training framework that reduces this requirement by leveraging unannotated 2D images collections with only a single rigged canonical mesh per category. Starting from a weak 3D shape predictor trained on canonical-pose renders, we iteratively estimate object articulation and camera pose by fitting the mesh to predicted point maps. The recovered articulations and viewpoints are then used to render updated synthetic training data, progressively improving the predictor. Despite using substantially weaker 3D supervision, our models achieve performance comparable with DualPM, which requires manually curated articulated training datasets.

URL PDF HTML 收藏