arXivDaily arXiv每日学术速递 周一至周五更新

高校专区

University of Michigan(密歇根大学安娜堡分校)

至 收录 1112
2607.18114 2026-07-21 cs.CL cs.AI cs.LG 新提交

How Does Alignment Tuning Shape Representations of Sycophancy and Related Cue-Induced Biases in LLMs?

对齐调整如何塑造大语言模型中谄媚及相关线索诱导偏差的表征?

Prakhar Gupta, Terry Jingchen Zhang, Florent Draye, Bernhard Schölkopf, Zhijing Jin

机构 * University of Michigan(密歇根大学) Jinesis Lab, University of Toronto & Vector Institute(多伦多大学Jinesis实验室和向量研究所) Max-Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所) ELLIS Institute Tübingen(图宾根ELLIS研究所)

AI总结 研究大语言模型中谄媚及相关线索诱导偏差的位置,通过从隐藏状态提取偏差方向并经探测等三种方法三角测量,发现易感性由对齐调整而非预训练导致,还能适度去偏,偏差是对齐调整安装的不同因果活性方向。

详情
AI中文摘要

现代大语言模型极易受到输入提示中简单无形变化的影响:一个随意的暗示、一个标注错误的少样本示例或一个虚假的先前助手回复往往会使原本正确的答案翻转。我们研究这种涵盖谄媚及相关线索诱导偏差的易感性在模型内部的位置。跨越五个模型家族和七种BCT偏差类型,我们从隐藏状态中提取每个偏差方向,并通过三种方法进行三角测量:探测、留一数据集转移和因果干预。这种易感性很大程度上是由对齐调整而非预训练造成的:预训练的基础模型几乎不受这些偏差影响,其激活除了问题内容外没有特定线索信号。在对齐模型中,每个偏差成为一个单一连贯方向,我们既能解码又能引导,在每个测试家族中恢复无偏差答案。偏差在表征上保持 distinct,交叉偏差纠缠是特定于模型而非偏差类别的属性,行为相似的偏差也占据不同方向。相同的干预也是一种适度的去偏工具,在保留所有指令家族中大多数正确答案的同时,恢复了相当一部分偏差诱导的错误。因此,线索诱导偏差最好理解为对齐调整所安装的一组不同的、具有因果活性的方向,而不是大语言模型中的单一缺陷。

英文摘要

Modern LLMs are alarmingly susceptible to surprisingly simple immaterial changes of input prompts: a casual hint, an incorrectly labeled few-shot example, or a fake prior assistant turn often flips an originally correct answer. We study where this susceptibility, spanning sycophancy and related cue-induced biases, lives inside the model. Across five model families and seven BCT bias types, we extract a per-bias direction from hidden states and triangulate it through three measures: probing, leave-one-dataset-out transfer, and causal intervention. The susceptibility is largely installed by alignment tuning rather than pretraining: pretrained base models barely cave to these biases, and their activations carry no cue-specific signal beyond question content. Within aligned models, each bias becomes a single coherent direction that we can both decode and steer along, recovering the unbiased answer across every family we test. The biases stay representationally distinct, however: cross-bias entanglement is model-specific rather than a property of the bias category, and even behaviorally similar biases occupy different directions. The same intervention also serves as a modest debiasing tool, recovering a meaningful share of bias-induced errors while preserving most correct answers across all instruct families. Cue-induced bias is therefore best understood not as a single flaw in LLMs but as a family of distinct, causally active directions that alignment tuning installs.

URL PDF HTML 收藏
2607.17454 2026-07-21 cs.RO 新提交

Test-Time Scaling for World Action Models via Zero-Shot Geometric Evaluation

通过零样本几何评估实现世界行动模型的测试时缩放

Zesen Zhao, Minkyoung Cho, Hui shen, Boyuan Zheng, Kunxiao Gao, Yulong Cao, Z. Morley Mao

机构 * University of Michigan(密歇根大学) NVIDIA(英伟达)

AI总结 研究针对世界行动模型,提出无需训练的选择性测试时缩放框架\methodgated,基于预测未来的跨视图深度重投影一致性排序,经实验验证该方法能提高任务成功率,同时减少额外采样决策点,还识别出相关失败模式。

Comments Extened version of CVPR 2026 EAI workshop

详情
AI中文摘要

测试时缩放通过额外计算改进基础模型推理,但机器人控制需在执行动作前决定额外计算是否有用。世界行动模型(WAMs)使此决策自然化。我们提出了\methodgated,一种用于WAMs的无需训练的选择性测试时缩放框架。首先实例化\method,一个固定预算的最佳N选择器,通过预测未来的跨视图深度重投影一致性对采样的展开进行排序。\methodgated添加了一个轻量级的动作-未来一致性门,仅在初始展开内部不一致时调用\method。在五个基准设置上的实验表明,固定预算的\method在每个设置中都提高了N=8任务的成功率,启用门控后,\methodgated平均恢复了74.8%的始终开启的成功率提升,同时仅在26.2%的决策点触发额外采样。离线诊断表明跨视图重投影是一个强大的无任务标签选择器,我们将错误的低分选择识别为一种失败模式,有助于解释为什么随着N的增加性能会饱和或下降。

英文摘要

Test-time scaling improves foundation-model inference by spending additional computation, but robot control requires deciding whether extra compute is useful before executing an action. World Action Models (WAMs) make this decision natural: each rollout exposes both an action chunk and predicted future observations. We propose \methodgated, a training-free selective test-time scaling framework for WAMs. We first instantiate \method, a fixed-budget Best-of-$N$ selector that ranks sampled rollouts by cross-view depth reprojection consistency of their predicted futures, computed with a frozen geometry foundation model. \methodgated\ adds a lightweight action--future consistency gate that invokes \method\ only when the initial rollout appears internally inconsistent. Across five benchmark--backbone settings on RoboCasa, LIBERO Long, and RoboTwin~2.0, fixed-budget \method\ improves $N{=}8$ task success in every setting, e.g., raising the RoboCasa group average from $66.3\%$ to $68.4\%$ with Cosmos Policy and from $80.8\%$ to $82.5\%$ with X-WAM. With gating enabled, \methodgated\ recovers on average $74.8\%$ of the always-on success gain while triggering additional sampling on only $26.2\%$ of decision points. Offline diagnostics show that cross-view reprojection is a strong task-label-free selector, and we identify false low-score selections as a failure mode that helps explain why performance can saturate or degrade as $N$ increases.

URL PDF HTML 收藏
2607.16288 2026-07-21 cs.CV 新提交

A Synthetic 3D Gear Dataset for Manufacturing Quality Inspection (MFGNet-Gear)

用于制造质量检测的合成3D齿轮数据集(MFGNet-Gear)

Ruo-Syuan Mei, Chenhui Shao

机构 * University of Michigan(密歇根大学)

AI总结 研究针对智能制造中基于深度学习的零件质量检测数据难题,提出构建MFGNet-Gear合成3D数据集,通过参数化生成齿轮几何形状与缺陷,涵盖多种设计和质量等级,提供标注数据,助力相关检测、学习及基准测试,推动3D计量学发展。

详情
AI中文摘要

智能制造中的质量控制越来越依赖数据驱动方法,特别是深度学习来自动检测制造零件。3D计量学的进展实现了对尺寸精度、表面质量和形状一致性的精细评估。然而,基于点云的深度学习检测方法需要大量涵盖零件设计和缺陷类型的标注数据,获取成本高且耗时。此外,批量生产中缺陷零件很少,类不平衡会降低模型性能。合成数据生成提供了一种有前景的方法来应对这些挑战。本文介绍了MFGNet-Gear,一个公开可用的合成3D数据集,包含24000对多边形网格和点云,涵盖12种齿轮设计和4个质量等级。齿轮几何形状由参数化计算机辅助设计软件生成,尺寸参数受±0.0254毫米的扰动,缺陷参数从代表缺陷形态的分布中采样。对于每个网格,使用Open3D均匀采样100000个点并存储为N×3坐标文本文件。元数据标签识别齿轮设计和质量等级,支持零件设计分类、几何缺陷检测、表示学习和数据集基准测试。MFGNet-Gear为基于深度学习的3D计量学提供了一个开源数据集,其可重复生成管道可扩展到其他零件设计。

英文摘要

Quality control in smart manufacturing increasingly relies on data-driven methods, particularly deep learning, to automate the inspection of manufactured parts. Recent advances in three-dimensional (3D) metrology have enabled fine-scale assessment of dimensional accuracy, surface quality, and shape conformity. However, deep learning methods for point-cloud-based inspection require large volumes of labeled data covering part designs and defect types, which are costly and time-consuming to obtain. Moreover, defective parts are intrinsically rare in mass production, and the resulting class imbalance can degrade model performance and make rare defect types difficult to detect. Synthetic data generation (SDG) offers a promising approach to address these challenges by producing large, balanced, and fully annotated datasets. Yet, applying SDG to precision components requires representing part geometry and defect morphology parametrically, so that design and quality can be co-varied. This article describes MFGNet-Gear, a publicly available synthetic 3D dataset comprising 24,000 paired polygon meshes and point clouds across 12 gear designs and 4 quality classes, with 500 instances per design-quality combination. Gear geometries are generated with parametric computer-aided design software, with dimensional parameters perturbed by $\pm$0.0254 mm and defect parameters sampled from distributions representing defect morphologies. For each mesh, 100,000 points are uniformly sampled using Open3D and stored as N $\times$ 3 coordinate text files. Metadata labels identify the gear design and quality class, supporting part design classification, geometric defect detection, representation learning, and dataset benchmarking. MFGNet-Gear provides an open-source dataset for deep learning-based 3D metrology, with a reproducible generation pipeline extensible to additional part designs.

URL PDF HTML 收藏
2606.08015 2026-07-21 cs.RO 版本更新

Q-VGM: Q-Value-Gradient Matching for Off-Policy Reinforcement Learning of Flow-Matching VLA

Q-VGM: 基于Q引导的值梯度匹配的流匹配VLA策略

Ziqian Wang, Yitian Liu, Xingjian Mao, Minqian Wang, Yao Mu

机构 * Shanghai Jiao Tong University(上海交通大学) University of Michigan, Ann Arbor(密歇根大学安娜堡分校) University of Electronic Science and Technology of China(电子科技大学)

AI总结 提出Q-VGM离线强化学习方法,通过将值梯度转化为去噪时间上的值梯度场,避免反向传播去噪链,高效微调流匹配VLA策略,在LIBERO等任务上显著提升成功率。

Comments 13 pages, 3 figures, 4 tables

详情
AI中文摘要

我们提出Q引导的值梯度匹配(Q-VGM),一种离线强化学习方法,解决了微调流匹配视觉-语言-动作(VLA)策略中长期存在的挑战:如何高效地根据学习到的Q函数改进一个表达力强的流匹配动作专家。有效的改进必须利用评论家的一阶(梯度)信息,但这对于流策略很困难,因为直接通过其多步去噪过程反向传播值函数在VLA规模下数值不稳定,而策略梯度方法所需的可处理动作似然在迭代去噪下不可用。现有的基于值的方法要么通过整个去噪链反向传播,要么仅在测试时使用评论家而不更新策略,要么将评论家改进的动作作为终端标签蒸馏而不监督速度场。Q-VGM通过利用VGG-Flow(一种生成建模中流对齐的值梯度视角)绕过了这些问题,它将值梯度转化为去噪时间上的值梯度场,而不是不稳定的端到端目标。这不需要动作似然,也不需要反向传播去噪链,并且在一个固定的重放缓冲区上操作。评论家是一个动作敏感的Cal-QL集成,基于紧凑的RLT特征和每层动作注入。Q-VGM实现了一种实用的少样本初始化然后从经验中学习的范式:从少样本SFT pi0.5 VLA开始,该方法利用自生成的rollout数据显著提升任务性能,无需额外的专家监督。在LIBERO上,Q-VGM将平均成功率从75.0%提升到92.5%;在RoboTwin 2.0上,从76.4%提升到87.2%;在两个真实机器人桌面任务上,从40.0%提升到67.5%,在所有三种设置中均优于所有相同骨干、相同评论家的基线。

英文摘要

We propose Q-Guided Value-Gradient Matching (Q-VGM), an off-policy reinforcement learning method for a central difficulty in fine-tuning flow-matching vision-language-action (VLA) policies: improving an expressive flow-matching action expert with a learned $Q$-function. Effective improvement must exploit the critic's first-order signal $\nabla_A Q$, yet flow policies make this hard: backpropagating values through the multi-step denoising chain is unstable at VLA scale, and the tractable action likelihoods required by policy gradients are unavailable under iterative denoising. Existing value-based methods therefore backpropagate through the full chain, use the critic only for test-time selection or guidance, or distill critic-improved actions as terminal labels that never supervise the velocity field. Q-VGM instead casts policy improvement as optimal control over the denoising dynamics, where the optimal residual velocity is the gradient of a denoising-time value function: clean-action estimates improved by iterative $Q$-gradient ascent with keep-best selection are converted into residual velocity targets that directly supervise the velocity field -- no action likelihoods, no backpropagation through the denoising chain, fully offline on a fixed replay buffer, and no critic at inference time. The critic is an action-sensitive stepwise IQL critic on compact latent states from the frozen VLA backbone. This enables a few-shot-initialization, learn-from-experience paradigm: starting from a few-shot-SFT $π_{0.5}$ policy, Q-VGM improves the policy from its own rollouts without additional expert supervision, raising the average LIBERO success rate from 79.0% to 92.5%, outperforming all same-backbone, same-critic baselines, and attaining high success rates on four real-robot manipulation tasks, including fine-grained plug insertion.

URL PDF HTML 收藏
2511.21600 2026-07-21 cs.CR cs.LG

Robust Spectral Watermark for Synthetic Tabular Data

稳健的频域水印用于合成表格数据

Yizhou Zhao, Xiang Li, Peter Song, Qi Long, Weijie Su

机构 * University of Pennsylvania(宾夕法尼亚大学) University of Michigan(密歇根大学)

AI总结 本文提出TAB-DRW水印方案,通过频域嵌入和秩基伪随机生成提升合成表格数据的鲁棒性和效率,实验显示其在抗后处理攻击和保持数据保真度方面表现优异。

Comments Accepted to Statistical Learning and Data Science

Journal ref Statistical Learning and Data Science (2026), Article 100001

详情
AI中文摘要

生成式AI的兴起使医疗、金融和公共政策等领域能够生成高保真的合成表格数据,引发了数据溯源和滥用的担忧。水印技术通过确保合成数据的可追溯性来应对这些挑战,但现有方法存在计算成本高、难以处理混合离散-连续数据或抗后处理攻击能力差的问题。为了解决这些问题,我们提出TAB-DRW,一种高效的合成表格数据后编辑水印方案。TAB-DRW在频域嵌入水印信号:通过Yeo-Johnson变换和标准化对异质特征进行归一化,应用离散傅里叶变换(DFT),并根据预计算的伪随机位调整自适应选择条目的虚部。为进一步增强鲁棒性和效率,我们引入了一种新的基于秩的伪随机位生成方法,该方法能够在不产生存储开销的情况下实现行级检索。在五个基准表格数据集上的实验表明,TAB-DRW在检测能力和抗后处理及自适应攻击能力方面表现强劲,同时保持高数据保真度并完全支持混合类型特征。

英文摘要

The rise of generative AI has enabled the production of high-fidelity synthetic tabular data across fields such as healthcare, finance, and public policy, raising growing concerns about data provenance and misuse. Watermarking offers a promising solution to address these concerns by ensuring the traceability of synthetic data, but existing methods face many limitations: they are computationally expensive due to reliance on the inverse process of large diffusion models, struggle with mixed discrete-continuous data, or lack robustness to common post-processing attacks. To address these limitations, we propose TAB-DRW, an efficient and robust post-editing watermarking scheme for synthetic tabular data. TAB-DRW embeds watermark signals in the frequency domain: it normalizes heterogeneous features via the Yeo-Johnson transformation and standardization, applies the discrete Fourier transform (DFT), and adjusts the imaginary parts of adaptively selected entries according to precomputed pseudorandom bits. To further enhance robustness and efficiency, we introduce a novel rank-based pseudorandom bit generation method that enables row-wise retrieval without incurring storage overhead. Experiments on five benchmark tabular datasets show that TAB-DRW achieves strong detectability and robustness against post-processing and adaptive attacks, while preserving high data fidelity and fully supporting mixed-type features.

URL PDF HTML 收藏
2603.17068 2026-07-21 cs.CV cs.RO 版本更新

TrackDeform3D: Markerless and Autonomous 3D Keypoint Tracking and Dataset Collection for Deformable Objects

TrackDeform3D: 无标记和自主的3D关键点跟踪及变形物体数据集采集

Yeheng Zong, Yizhou Chen, Alexander Bowler, Chia-Tung Yang, Ram Vasudevan

机构 * Department of Robotics at the University of Michigan(密歇根大学机器人系)

AI总结 本文提出了一种低成本自主框架,利用RGB-D相机采集变形物体的3D数据集,通过3D关键点跟踪和运动一致性约束提升几何和跟踪精度,构建了包含6种变形物体的高质量大规模数据集。

详情
AI中文摘要

结构化的3D表示,如关键点和网格,提供了紧凑且富有表现力的变形物体描述,联合捕捉几何和拓扑信息,对下游任务如动态建模和运动规划至关重要。然而,稳健地提取此类表示仍然具有挑战性,因为当前感知方法难以处理复杂变形。此外,大规模3D数据采集仍是一个瓶颈:现有方法要么需要耗费大量数据收集努力,如劳动密集型标注或昂贵的运动捕捉设备,要么依赖于简化假设,在无结构环境中失效。因此,大规模变形物体3D数据集和基准仍然稀缺。为解决这些挑战,本文提出了一种低成本且自主的框架,仅使用RGB-D相机采集变形物体的3D数据集。所提方法识别3D关键点并稳健地跟踪其轨迹,结合运动一致性约束,产生时间上平滑且几何上一致的数据。TrackDeform3D在多种物体类别上评估了多种最新跟踪方法,证明在几何和跟踪精度上均取得一致改进。使用该框架,本文呈现了一个高质量、大规模的数据集,包含6种变形物体,总轨迹数据时长110分钟。

英文摘要

Structured 3D representations such as keypoints and meshes offer compact, expressive descriptions of deformable objects, jointly capturing geometric and topological information useful for downstream tasks such as dynamics modeling and motion planning. However, robustly extracting such representations remains challenging, as current perception methods struggle to handle complex deformations. Moreover, large-scale 3D data collection remains a bottleneck: existing approaches either require prohibitive data collection efforts, such as labor-intensive annotation or expensive motion capture setups, or rely on simplifying assumptions that break down in unstructured environments. As a result, large-scale 3D datasets and benchmarks for deformable objects remain scarce. To address these challenges, this paper presents an affordable and autonomous framework for collecting 3D datasets of deformable objects using only RGB-D cameras. The proposed method identifies 3D keypoints and robustly tracks their trajectories, incorporating motion consistency constraints to produce temporally smooth and geometrically coherent data. TrackDeform3D is evaluated against several state-of-the-art tracking methods across diverse object categories and demonstrates consistent improvements in both geometric and tracking accuracy. Using this framework, this paper presents a high-quality, large-scale dataset consisting of 6 deformable objects, totaling 110 minutes of trajectory data. Project page: https://roahmlab.github.io/trackDeform3D-core-tracking/

URL PDF HTML 收藏
2507.04384 2026-07-21 cs.RO cs.SY eess.SY 版本更新

Rapid and Safe Trajectory Planning over Diverse Scenes through Diffusion Composition

通过扩散合成在多样场景中进行快速且安全的轨迹规划

Wule Mao, Zhouheng Li, Yunhao Luo, Fangguo Zhao, Lei Xie

机构 * College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院) University of Michigan(密歇根大学) MIT(麻省理工学院)

AI总结 针对动态环境规划难题,提出能量参数化扩散规划框架,结合轻量级安全过滤器和场景无关的数据生成管道,实现多样场景下快速安全规划,仿真与真实实验验证了其有效性、鲁棒性和适用性。

详情
AI中文摘要

在动态环境中实现安全、高效且运动学上可行的规划仍是重大挑战,规划者须同时应对移动障碍物、传感器不确定性和严格运动约束。为此,我们提出能量参数化扩散规划框架,学习保守能量场以在多样场景中实现安全稳定泛化。该公式能灵活整合多种约束,无需重新训练即可泛化到未见环境。为确保部署时的实时安全,还纳入轻量级安全过滤器。此外,开发了基于场景无关的MPC数据生成管道。仿真中,平均规划时间0.21秒,规划失败率0.57%。F1TENTH平台的真实实验进一步验证其有效性,在未见动态环境中能生成无碰撞轨迹,平均避障间隙0.26米,展现出强大的鲁棒性和实际适用性。

英文摘要

Achieving safe, efficient, and kinematically feasible planning in dynamic environments remains a significant challenge, as planners must simultaneously handle moving obstacles, sensor uncertainty, and strict motion constraints. To address this problem, we propose an energy-parameterized diffusion planning framework that learns a conservative energy field to realize safe and stable generalization across diverse scenarios. The energy-parameterized diffusion formulation enables flexible integration of multiple constraints, allowing the planner to generalize to previously unseen environments without retraining. To ensure real-time safety during deployment, we further incorporate a lightweight safety filter that enforces safety and kinematic feasibility constraints in real-time. Additionally, we develop a scene-agnostic, MPC-based data generation pipeline to produce large-scale, dynamically feasible training trajectories. In simulation, the proposed method achieves real-time performance with a mean planning time of 0.21s and a low planning failure rate of 0.57%. Real-world experiments on the F1TENTH platform further validate the effectiveness of the proposed framework. Under sensor uncertainty in previously unseen dynamic environments, the planner consistently generates collision-free trajectories, which remain safe after being tracked by a simple controller, maintaining a mean obstacle clearance of 0.26 m, demonstrating strong robustness and practical applicability. Project page: https://rstp-comp-diffuser.github.io.

URL PDF HTML 收藏
2506.03066 2026-07-21 cs.LG stat.ML 版本更新

Sign-SZPO: Provable Preference-based Reinforcement Learning with an Unknown Link Function

Sign-SZPO:具有未知链接函数的基于可证明偏好的强化学习

Qining Zhang, Lei Ying

机构 * University of Michigan(密歇根大学)

AI总结 研究具有未知链接函数的基于偏好的强化学习问题,提出Sign-SZPO零阶策略优化算法,该算法仅估计价值函数差的符号来构建更新方向,可证明收敛到平稳策略,实证显示其在链接函数错误指定下具有鲁棒性。

详情
AI中文摘要

链接函数表征了对两条轨迹的偏好与其回报之间的关系,是设计从偏好反馈中学习的强化学习算法的关键组成部分。现有大多数方法都假设链接函数已知,鉴于偏好的复杂性,这具有局限性。本文研究了具有未知链接函数的基于偏好的强化学习,并提出了一种名为Sign-SZPO的新型零阶策略优化算法。它仅估计价值函数差异的符号,构建与真实策略梯度正相关的参数更新方向,无需精确知道链接函数。在温和条件下,Sign-SZPO可证明以多项式速率收敛到平稳策略。实证评估进一步证明了Sign-SZPO在链接函数错误指定下的鲁棒性。

英文摘要

The link function, which characterizes the relationship between the preference for two trajectories and their returns, is a crucial component in designing RL algorithms that learn from preference feedback. Most existing methods, both theoretical and empirical, assume that the link function is known (often a logistic function based on the Bradley-Terry model), which is arguably restrictive given the complex nature of preferences, especially those of humans. To avoid mis-specification, this paper studies preference-based RL with an unknown link function and proposes a novel zeroth-order policy optimization algorithm called Sign-SZPO. Unlike typical zeroth-order methods, which rely on the known link function to estimate the value function differences and form a gradient estimator, Sign-SZPO only estimates the sign of the value function difference. It then constructs a parameter update direction that is positively correlated with the true policy gradient, eliminating the need to know the link function exactly. Under mild conditions, Sign-SZPO provably converges to a stationary policy with a polynomial rate in the number of policy iterations and trajectories per iteration. Empirical evaluations further demonstrate the robustness of Sign-SZPO under link function mis-specifications.

URL PDF HTML 收藏
2607.15633 2026-07-20 cs.RO 新提交

Scalable Open-Source Visuotactile Sensor for 6-Axis Contact Wrench Estimation in Tensegrity Robots

用于张拉整体机器人六轴接触力扳手估计的可扩展开源视觉触觉传感器

Wenzhe Tong, Jonathan Mi, Xili Yi, Nima Fazeli, Xiaonan Huang

机构 * University of Michigan(密歇根大学)

AI总结 本文针对张拉整体机器人提出可扩展开源视觉触觉传感系统,通过集成弹性体外壳等部件及螺旋状填充粘结技术,利用触觉到扳手的神经网络实现六轴力扳手估计,实验验证其准确性和稳定性,提升了机器人触觉反馈实用性。

Comments 8 pages, 10 figures, IROS 2026

详情
AI中文摘要

本文提出了一种用于张拉整体机器人的可扩展开源视觉触觉传感系统,可实现六轴力扳手估计和接触检测。所提出的端盖传感器集成了弹性体外壳、3D打印热塑性聚氨酯(TPU)接口和刚性底座,底座内有嵌入式摄像头和LED照明环。引入了一种新颖的螺旋状填充粘结技术,无需粘合剂即可形成耐用的弹性体-TPU接口,实现了与大型张拉整体结构兼容的轻质模块化设计。通过触觉到扳手的神经网络将剪切矢量场映射到六维力和扭矩测量。实验结果表明,在静态验证数据上的均方误差(MSE)为0.1531,在动态运动下具有准确稳定的扳手估计和域外泛化能力。此外,在12kg张拉整体机器人上的全系统集成证实了该传感器可靠识别地面接触的能力。该系统大大提高了张拉整体机器人触觉反馈的实用性,为接触感知本体感觉和状态估计提供了低成本、可重复且具有物理可解释性的途径。开源文件可在指定网址获取。

英文摘要

This paper presents a scalable, open-source visuotactile sensing system for tensegrity robots that enables six-axis wrench estimation and contact detection. The proposed endcap sensor integrates an elastomeric shell, a 3D-printed thermoplastic polyurethane (TPU) interface, and a rigid base housing an embedded camera and LED illumination ring. A novel gyroid-infill bonding technique is introduced to form a durable elastomer-TPU interface without adhesives, yielding a lightweight and modular design compatible with large-scale tensegrity structures. A tactile-to-wrench neural network maps shear vector fields to six-dimensional force and torque measurements. Experimental results demonstrate accurate and stable wrench estimation with a mean squared error (MSE) of 0.1531 on static validation data and out-of-domain generalization under dynamic motion. Furthermore, full-system integration on a 12 kg tensegrity robot confirms the sensor's ability to reliably identify ground contacts. The system substantially improves the practicality of tactile feedback for tensegrity robots, offering a low-cost, reproducible, and physically interpretable pathway toward contact-aware proprioception and state estimation. Open source files are available at \href{https://github.com/Jonathan-Twz/tensegrity-gelfoot}{github.com/Jonathan-Twz/tensegrity-gelfoot}

URL PDF HTML 收藏
2607.15536 2026-07-20 cs.CV cs.LG 新提交

E3DGS: Unified Geometric-Photometric Equivariance for 3D Gaussian Splatting via Color-as-Geometry Embedding

E3DGS:通过颜色作为几何嵌入实现3D高斯点云的统一几何-光度等变性

Chankyo Kim, Maani Ghaffari

机构 * University of Michigan(密歇根大学)

AI总结 研究针对3D高斯点云构建等变架构的表示瓶颈问题,提出基于表示理论的统一解决方案,通过将光度学与几何张量同构等方法,引入统一矩阵嵌入,构建E3DGS架构,提升了相机帧变化下的鲁棒性和数据效率。

Comments 31 pages, 7 figures, 5 tables

详情
AI中文摘要

3D高斯点云(3DGS)通过将显式几何(位置、协方差)与视图相关的光度学(球谐函数)相结合来捕捉场景。然而,在这些基元上构建$\mathrm{SE}(3)$等变架构存在基本的表示瓶颈。颜色一直被视为信号而非几何实体,在相机帧变化时统一几何和外观的对称性并非易事。平移由相对坐标处理,而旋转对不同属性的作用方式不同。这种不匹配使严格等变性变得复杂,导致现有方法要么丢弃要么扁平化SH系数,从而破坏对称性。我们提出了一种基于表示理论的统一解决方案:对于SH度数$\ell\leq2$,光度学在代数上与秩为2的几何张量同构。我们证明了对这些SH系数的维格纳-$D$作用可以精确地重新表述为对$3\times3$矩阵的共轭作用。利用这一点,我们引入了统一矩阵嵌入,将所有高斯属性映射到统一的载体空间$\mathfrak{gl}(3)$。基于“颜色即几何”的公式,我们提出了E3DGS,一种无需克莱布施-戈尔丹张量积就能处理3D高斯的刚体($\mathrm{SE}(3)$)等变架构。在物体视觉和动作条件高斯世界建模上的评估表明,我们的统一方法在相机帧变化下具有很强的鲁棒性,并提高了数据效率。

英文摘要

3D Gaussian Splatting (3DGS) captures scenes by coupling explicit geometry (position, covariance) with view-dependent photometry (Spherical Harmonics). However, building $\mathrm{SE}(3)$-equivariant architectures on these primitives presents a fundamental representation bottleneck. Color has been treated as a signal rather than a geometric entity, making it nontrivial to unify symmetry across geometry and appearance as the camera frame changes. While translations are handled by relative coordinates, rotations act heterogeneously across attributes: $μ\mapsto Rμ$, $Σ\mapsto RΣR^\top$, and $f_\ell\mapsto D^\ell(R)f_\ell$. This mismatch complicates strict equivariance, leading existing methods to either discard or flatten SH coefficients, thereby breaking symmetry. We propose a unified solution rooted in representation theory: for SH degrees $\ell\le2$, photometry is algebraically isomorphic to a rank-2 geometric tensor. We prove that the Wigner-$D$ action on these SH coefficients can be exactly reformulated as the conjugation action on $3\times3$ matrices. Leveraging this, we introduce the Unified Matrix Embedding, a lifting that maps all Gaussian attributes into a unified carrier space, $\mathfrak{gl}(3)$. Building on the "Color-as-Geometry" formulation, we present E3DGS, a rigid-body ($\mathrm{SE}(3)$) equivariant architecture that processes 3D Gaussians without Clebsch-Gordan tensor products. Evaluations on object vision and action-conditioned Gaussian world modeling demonstrate that our unified approach yields strong robustness under camera-frame changes and improved data efficiency.

URL PDF HTML 收藏
2606.10931 2026-07-20 cs.CL 版本更新

It Takes One to Bias Them All: Breaking Bad with One-Shot GRPO

一个样本就能带偏所有:单次GRPO打破对齐

Naihao Deng, Yilun Zhu, Naichen Shi, Clayton Scott, Rada Mihalcea

机构 * University of Michigan(密歇根大学) Northwestern University(西北大学)

AI总结 研究发现,仅用单个有偏样本进行一步GRPO训练就能诱导大语言模型产生系统性偏见,且刻板印象推理泛化到多种属性、类别和基准测试,揭示了对齐机制的关键脆弱性。

Comments COLM 2026

详情
AI中文摘要

警告:本文包含若干有毒和冒犯性言论。现代大语言模型通常通过大规模后训练进行对齐,以确保公平和可靠的行为。在本工作中,我们研究了通过群体相对策略优化(GRPO)打破这些防护栏的容易程度。我们表明,在单个有偏样本上进行一次GRPO训练就足以诱导系统性偏见,且基于刻板印象的推理会泛化到不同属性、类别和基准测试中。我们进一步发现,模型基于初始产生有偏输出的可能性而表现出不同的易感性。我们的结果揭示了后训练中的一个关键脆弱性:对齐可以被单个样本覆盖。

英文摘要

Warning: This paper contains several toxic and offensive statements. Modern large language models (LLMs) are typically aligned through large-scale post-training to ensure fair and reliable behavior. In this work, we investigate how easily such guardrails can be broken by Group Relative Policy Optimization (GRPO). We show that one-shot GRPO training on a single biased example is sufficient to induce systematic bias, with stereotype-driven reasoning generalizing across attributes, categories, and benchmarks. We further find that models differ in their susceptibility based on the initial likelihood of producing biased outputs. Our results reveal a critical vulnerability in post-training: alignment can be overridden by a single example.

URL PDF HTML 收藏
2512.07019 2026-07-20 stat.ME cs.AI stat.AP stat.ML 版本更新

Latency-Response Theory Model: Evaluating Large Language Models via Response Accuracy and Chain-of-Thought Length

延迟-响应理论模型:通过响应准确性和思维链长度评估大语言模型

Zhiyu Xu, Jia Liu, Yixin Wang, Yuqi Gu

机构 * Department of Statistics, Columbia University(哥伦比亚大学统计系) Department of Statistics, University of Michigan(密歇根大学统计系)

AI总结 针对大语言模型评估问题,提出延迟-响应理论(LaRT)模型,联合考虑响应准确性和思维链长度,通过引入关键参数建模,推导高效算法估计参数,经理论和模拟研究验证其优势,实际数据评估中表现优于项目反应理论(IRT)。

详情
AI中文摘要

大语言模型的扩散需要有效的评估方法。项目反应理论(IRT)模型与计算机自适应测试最近成为通过响应准确性评估大语言模型的有前景框架。除了简单的响应准确性,大语言模型的思维链长度是其推理能力的重要指标。为利用思维链长度信息辅助大语言模型评估,我们提出延迟-响应理论(LaRT)模型,通过引入潜在能力和潜在速度之间的关键相关参数,联合建模响应准确性和思维链长度。我们推导了用于参数估计的高效随机近似期望最大化算法,建立了潜在能力和潜在速度参数的严格可识别性结果。通过理论渐近分析和模拟研究,证明LaRT在潜在特质估计的准确性和置信区间方面优于IRT。在实际数据中评估发现,LaRT在多个关键评估指标上优于IRT且产生不同的大语言模型排名。代码和数据可获取。

英文摘要

The proliferation of Large Language Models (LLMs) necessitates valid evaluation methods to provide guidance for both downstream applications and actionable future improvements. The Item Response Theory (IRT) model with Computerized Adaptive Testing has recently emerged as a promising framework for evaluating LLMs via their response accuracy. Beyond simple response accuracy, LLMs' chain of thought (CoT) lengths serve as a vital indicator of their reasoning ability. To leverage the CoT length information to assist LLM evaluation, we propose the \textbf{La}tency-\textbf{R}esponse \textbf{T}heory (LaRT) model, which jointly models both the response accuracy and CoT length by introducing a key correlation parameter between the latent ability and the latent speed. We derive an efficient stochastic approximation Expectation-Maximization algorithm for parameter estimation. We establish rigorous identifiability results for the latent ability and latent speed parameters to ensure the statistical validity of their estimation. Through both theoretical asymptotic analyses and simulation studies, we demonstrate LaRT's advantages over IRT in terms of superior estimation accuracy and shorter confidence intervals for latent trait estimation. To evaluate LaRT in real data, we collect responses from diverse LLMs on popular benchmark datasets. We find that LaRT yields different LLM rankings than IRT and outperforms IRT across multiple key evaluation metrics including predictive power, item efficiency, ranking validity, and LLM evaluation efficiency. Code and data are available at https://github.com/Toby-X/Latency-Response-Theory-Model

URL PDF HTML 收藏
2409.10897 2026-07-20 cs.LG cs.SE 版本更新

AutoSpec: Automated Generation of Neural Network Specifications

AutoSpec:神经网络规范的自动生成

Shuowei Jin, Taobo Liao, Anuj Kalia, Xenofon Foukas, Huan Zhang, Cheng Tan, Z. Morley Mao, Francis Y. Yan

机构 * University of Michigan(密歇根大学) Microsoft Research(微软研究院) Northeastern University(东北大学) University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

AI总结 针对神经网络在学习增强系统中对模型安全鲁棒性需求,AutoSpec提出首个自动生成和评估神经网络规范的综合框架,通过基于树算法、统计认证框架及评估框架,经实验验证其性能优于手动定义规范和现有基线算法。

详情
AI中文摘要

神经网络在学习增强系统中的日益广泛应用凸显了对模型安全性和鲁棒性的需求,尤其是在安全关键领域。虽然神经网络验证的最新进展提供了最坏情况行为的形式保证,但现有方法要求用户手动定义模型规范,这一过程容易出错、不完整且耗时。本文提出了AutoSpec,这是首个用于为学习增强系统自动生成和评估神经网络规范的综合框架。AutoSpec引入了一种基于树的算法,该算法自适应地划分输入空间以生成与模型行为一致的规范集,以及一个统计认证框架,为每个规范提供严格的准确性保证。我们还提出了一个有原则的评估框架,该框架定义了规范准确性和覆盖范围的可解释指标,为未来研究建立了基准。在四个不同应用中的实验表明,AutoSpec优于手动定义的规范和现有的基线算法,比人工定义的规范提高F1分数高达53%,比最强基线提高73%。

英文摘要

The increasing adoption of neural networks in learning-augmented systems highlights the growing need for model safety and robustness, especially in safety-critical domains. While recent advances in neural network verification offer formal guarantees on worst-case behavior, existing approaches require users to manually define model specifications, an error-prone, incomplete, and time-consuming process. In this paper, we present AutoSpec, the first comprehensive framework for automatically generating and evaluating neural network specifications for learning-augmented systems. AutoSpec introduces a tree-based algorithm that adaptively partitions the input space to generate specification sets aligned with model behavior, as well as a statistical certification framework that provides rigorous accuracy guarantees for each specification. We also propose a principled evaluation framework that defines interpretable metrics for specification accuracy and coverage, establishing a benchmark for future research. Experiments across four diverse applications show that AutoSpec outperforms both manually defined specifications and existing baseline algorithms, improving the F1 score by up to 53% over human-defined specifications and 73% over the strongest baseline.

URL PDF HTML 收藏
2607.15242 2026-07-17 cs.LG 新提交

Mutable Low-Rank Sketches for Retrain-Free Recommendation

用于无再训练推荐的可变低秩草图

Hector J. Garcia, Nick Clayton

机构 * University of Michigan(密歇根大学) Criteo

AI总结 研究两阶段推荐中嵌入陈旧性问题,提出可变草图方法,将用户偏好存于KP树,一次拟合低秩投影,即时重算嵌入。证明可收紧预测误差范围,实验显示该方法在KuaiRec上效果好、更新快,新用户获推荐快,还比较了不同采样策略。

Comments 6 pages, 3 figures, 8 tables

详情
AI中文摘要

两阶段推荐中的一个常见瓶颈是嵌入陈旧性:当用户对新项目评分时,其嵌入在下次再训练周期之前保持不变。我们提出了可变草图,它将每个用户的偏好存储在KP树(具有求和聚合的稀疏段树)中,一次拟合低秩投影,并在评分到达时即时重新计算嵌入。我们证明每个新观察值都会单调收紧预测误差范围(定理1),这是FunkSVD和eALS所缺乏的保证。在KuaiRec上,可变草图在读取1.8%数据时RMSE达到0.810,而ALS在读取100%数据时RMSE为0.822,且每批更新速度快8倍。新用户首次评分后不到1毫秒即可获得个性化推荐,无需模型再训练。不同密度情况下采样策略的比较表明,KP树的范数比例采样在稀疏数据(密度<1%)上提供的项目覆盖率比均匀采样高40-130%,而在密集矩阵上均匀采样就足够了。

英文摘要

A common bottleneck in two-stage recommendation is embedding staleness: when a user rates a new item, their embedding remains fixed until the next retrain cycle. We propose mutable sketches, which store each user's preferences in a KP-tree (a sparse segment tree with sum aggregation), fit a low-rank projection once, and recompute embeddings on-the-fly as ratings arrive. We prove that each new observation monotonically tightens the prediction error envelope (Theorem 1), a guarantee that FunkSVD and eALS lack. On KuaiRec, the mutable sketch achieves 0.810 RMSE at 1.8% data read vs. ALS 0.822 at 100%, with 8x faster per-batch updates. A new user receives personalized recommendations in <1 ms after their first rating, with no model retraining required. A comparison of sampling strategies across density regimes shows that the KP-tree's norm-proportional sampling provides 40-130% better item coverage on sparse data (<1% density), while uniform sampling suffices on dense matrices.

URL PDF HTML 收藏
2607.14468 2026-07-17 cs.RO cs.MA cs.SY eess.SY 新提交

Mixed-Agent Museum Tour Guide Design Improves Gendered Learning Outcomes and Visitor Preferences

混合智能体博物馆导游设计提升性别化学习成果及游客偏好

Annette M. Masterson, Wonse Jo, Helena C. Sieh, Lionel P. Robert,, Dawn Tilbury

机构 * University of Michigan(密歇根大学) Incheon National University(仁川国立大学)

AI总结 研究博物馆中机器人导游,提出结合实体与虚拟智能体的混合导游系统,经30人受试者内研究验证,发现其提升女性学习表现,各条件下参与度和体验质量一致,且无论性别参与者都更偏好混合智能体团队。

Comments Accepted on IROS 2026, 8 pages

详情
AI中文摘要

机器人越来越多地融入日常场景,包括博物馆,它们既能娱乐游客也能进行教育。为增强游客体验与参与度,我们提出一种新型混合智能体导游系统,它将实体机器人与投影虚拟智能体相结合,通过对话和互动积极参与游览,从单一平台实现两个移动智能体的交互丰富性。我们通过一项有30名参与者的受试者内研究来验证该系统,评估参与度、体验质量和学习表现。参与者体验不同对话风格和智能体配置,通过调查、行为传感器和访谈收集数据。结果表明各条件下参与度和体验质量保持一致。学习表现显示出显著的性别调节差异:混合智能体条件提高了女性参与者的学习表现。这表明本文提出的二元对话风格对不同性别的学习表现有不同影响。尽管如此,在访谈中,无论性别,参与者都表示更偏好混合智能体团队,称互动是他们体验中的关键因素。

英文摘要

Robots are increasingly integrated into everyday contexts, including museums, where they can both entertain and educate visitors. To enhance visitor experience and engagement, we present a novel mixed-agent tour guide system that combines a physical robot with a projected virtual agent that actively participates in the tour through conversation and interaction, achieving the interaction richness of two mobile agents from a single platform. We validate the system through a within-subjects study with 30 participants to assess engagement, quality of experience, and learning performance. Participants experienced different conversational styles and agent configurations, and data were collected via surveys, behavioral sensors, and interviews. Results showed that engagement and quality of experience remained consistent across conditions. Learning performance revealed a significant gender-moderated difference: the mixed-agent conditions improved learning performance for female participants. This suggests that the proposed dyadic conversational style in this paper influenced learning performance differently by gender. Nonetheless, in interviews, participants reported a greater preference for mixed-agent teams regardless of gender, citing interaction as a key factor in their experience.

URL PDF HTML 收藏
2607.14367 2026-07-17 cs.LG 新提交

Dysco: Dynamic Subspace Boosting to Mitigate LoRA Interference in Federated Learning

Dysco:动态子空间增强以减轻联邦学习中的LoRA干扰

Haobo Zhang, Jiankun Wang, Suraj Rajendran, Weishen Pan, Lam Tsoi, Yong Chen, Fei Wang, Jiayu Zhou

机构 * University of Michigan(密歇根大学) Cornell University(康奈尔大学) University of Pennsylvania(宾夕法尼亚大学)

AI总结 研究针对联邦学习中异构客户端使LoRA聚合不稳定的问题,提出动态子空间增强方法Dysco,通过联邦动态分配特定客户端LoRA子空间,经实验验证其能减少干扰、降低训练损失、提升算法性能且开销小。

Comments 33 pages, 10 figures, 11 tables

详情
AI中文摘要

大型预训练模型的联邦微调越来越依赖低秩适应(LoRA)来减少通信和计算,但异构客户端会使适配器聚合不稳定。我们将数据参数干扰识别为这种不稳定性的几何根源。这种干扰由LoRA更新子空间与客户端激活之间的对齐控制,这表明联邦LoRA聚合不仅应视为参数平均,还应视为子空间分配。我们提出了动态子空间增强(Dysco),这是一种插件方法,以联邦和动态的方式分配特定于客户端的LoRA子空间。在每一轮中,客户端从本地表示中计算对激活不敏感的子空间,并仅传输所得的基;服务器然后通过一个封闭形式的解决方案构建特定于客户端的合并子空间,该解决方案最大化与其他客户端不敏感方向的兼容性。为了处理表示漂移,Dysco执行多轮子空间增强,以保留过去的更新方向,同时适应未来的表示。我们提供了一种收敛分析,将数据参数干扰作为聚合误差项嵌入标准联邦优化界,并证明Dysco的服务器固定合并子空间对该误差产生更紧的上界。在受控的合成联邦任务以及使用Llama-3.2-1B进行的MIMIC-IV临床笔记分类实验表明,Dysco大大减少了干扰,相对于理论确定的正交子空间划分下的基线,最终轮合成训练损失降低了多达9倍,在MIMIC上对所有五种测试的联邦学习算法提高了多达4.3%,优于最近的联邦LoRA方法,并且仅增加了0.9%的挂钟开销。我们的代码可在此https URL上获取。

英文摘要

Federated fine-tuning of large pre-trained models increasingly relies on Low-Rank Adaptation (LoRA) to reduce communication and computation, but heterogeneous clients can make adapter aggregation unstable. We identify the data-parameter interference as a geometric source of this instability. This interference is controlled by the alignment between LoRA update subspaces and client activations, suggesting that federated LoRA aggregation should be viewed not only as parameter averaging but also as subspace allocation. We propose Dynamic Subspace Boosting (Dysco), a plug-in method that allocates client-specific LoRA subspaces in a federated and dynamic manner. In each round, clients compute activation-insensitive subspaces from local representations and transmit only the resulting bases; the server then constructs client-specific merged subspaces through a closed-form solution that maximizes compatibility with other clients' insensitive directions. To handle representation drift, Dysco performs multi-round subspace boosting to preserve past update directions while adapting to future representations. We provide a convergence analysis that embeds the data-parameter interference as an aggregation-error term in a standard federated optimization bound, and prove that Dysco's server-fixed merged subspaces yield a tighter upper bound on this error. Experiments on controlled synthetic federated tasks and on MIMIC-IV clinical-note classification with Llama-3.2-1B show that Dysco substantially reduces interference, reduces the final-round synthetic training loss by up to 9 times relative to baselines under the orthogonal-subspace partition the theory identifies, improves all five tested FL algorithms by up to 4.3% on MIMIC, outperforms recent federated LoRA methods, and adds only 0.9% wall-clock overhead. Our code is available at https://github.com/illidanlab/Dysco.

URL PDF HTML 收藏
2603.18624 2026-07-17 cs.RO cs.AI cs.CV 版本更新

REST: Receding Horizon Explorative Steiner Tree for Zero-Shot Object-Goal Navigation

REST:基于零样本目标导航的视界探索Steiner树

Shuqi Xiao, Maani Ghaffari, Chengzhong Xu, Hui Kong

机构 * State Key Laboratory of Internet of Things for Smart City, University of Macau(智能城市物联网国家重点实验室,澳门大学) University of Michigan(密歇根大学)

AI总结 REST通过构建开放词汇3D地图、生成以代理为中心的路径树以及利用LLM推理选择最佳路径,在多个基准测试中实现了高成功率和高效路径效率。

Comments Accepted to IROS'26

详情
AI中文摘要

REST通过构建开放词汇3D地图、生成以代理为中心的路径树以及利用LLM推理选择最佳路径,在多个基准测试中实现了高成功率和高效路径效率。

英文摘要

Zero-shot object-goal navigation (ZSON) requires navigating unknown environments to find a target object without task-specific training. Prior hierarchical solutions mainly focus on either scene understanding and representations (belief) or high-level decision-making and planning (policy), yet treat the option, i.e., the subgoal candidate that belief proposes and policy selects, as an interface inherited from adjacent modules rather than a design axis in its own right. In practice, options are predominantly single waypoints scored by destination utility: a lone destination hides the value gathered en route, and a flat list obscures the relationships among candidates. Our insight is that the option space should be a tree of paths. Full paths expose en-route information gain that destination-only scoring systematically neglects; a tree of shared segments enables coarse-to-fine LLM reasoning that dismisses or pursues entire branches before examining individual leaves, compressing the combinatorial path space into an efficient hierarchy. We instantiate this insight in REST (Receding Horizon Explorative Steiner Tree), a training-free framework that (1) builds an explicit open-vocabulary 3D map from online RGB-D streams; (2) grows an agent-centric tree of safe and informative paths as the option space via sampling-based planning; and (3) textualizes each branch into a spatial narrative and selects the next-best path through chain-of-thought LLM reasoning. Across the Gibson, HM3D, and HSSD benchmarks, REST consistently ranks among the top methods in success rate and path efficiency.

URL PDF HTML 收藏
2510.24891 2026-07-17 cs.CL cs.LG 版本更新

Idea2Plan: Exploring AI-Powered Research Planning

Idea2Plan:探索人工智能驱动的研究规划

Jin Huang, Silviu Cucerzan, Sujay Kumar Jauhar, Ryen W. White

机构 * University of Michigan(密歇根大学) Microsoft Research(微软研究院)

AI总结 探讨大语言模型从概念研究想法到结构化研究计划的过渡能力,通过引入Idea2Plan任务、基准及JudgeEval评估,实验发现GPT-5表现最佳但仍有提升空间,为LLMs研究规划能力研究提供新见解和基础。

详情
AI中文摘要

大语言模型(LLMs)在加速科学发现方面展现出巨大潜力,可用于分析数据、生成假设等。本文研究LLMs如何从概念性研究想法过渡到结构化研究计划。有效研究规划对科学家推进研究及自主研究代理发展至关重要,但该领域对LLMs的研究规划能力缺乏系统理解。为此引入Idea2Plan任务和基准,包括从特定论文构建的基准实例及评分标准,还提出Idea2Plan JudgeEval评估基于LLMs的评判与专家注释的可靠性。实验表明GPT-5在基准测试中表现最强,但仍有提升空间。研究为LLMs的研究规划能力提供新见解并为未来进展奠定基础。

英文摘要

Large language models (LLMs) have demonstrated significant potential to accelerate scientific discovery as valuable tools for analyzing data, generating hypotheses, and supporting innovative approaches in various scientific fields. In this work, we investigate how LLMs can handle the transition from conceptual research ideas to well-structured research plans. Effective research planning not only supports scientists in advancing their research but also represents a crucial capability for the development of autonomous research agents. Despite its importance, the field lacks a systematic understanding of LLMs' research planning capability. To rigorously measure this capability, we introduce the Idea2Plan task and Idea2Plan Bench, a set of benchmarks built from ICML 2025 and Nature Mental Health papers released after major LLM training cutoffs. Each benchmark instance includes a research idea and a grading rubric capturing the key components of valid plans. We further propose Idea2Plan JudgeEval, a complementary benchmark to assess the reliability of LLM-based judges against expert annotations. Experimental results show that GPT-5 achieves the strongest performance on the benchmark, though substantial headroom remains for improvement. Our study provides new insights into LLMs' capability for research planning and lays the groundwork for future progress.

URL PDF HTML 收藏
2607.13669 2026-07-16 cs.CV 新提交

Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challenge

超越语言和模态限制学习说话者身份:来自POLY-SIM 2026挑战赛的见解

Marta Moscati, Muhammad Saad Saeed, Marina Zanoni, Mubashir Noman, Rohan Kumar Das, Monorama Swain, Yassin Terraf, Yufang Hou, Elisabeth Andre, Khalid Mahmood Malik, Markus Schedl, Shah Nawaz

机构 * Institute of Computational Perception, Johannes Kepler University(约翰内斯·开普勒大学计算感知研究所) University of Michigan-Flint(密歇根大学弗林特分校) BDO DIGITAL Gmbh(BDO数字有限公司) Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学) Fortemedia(富特媒体公司) College of Computing, Mohammed VI Polytechnic University(穆罕默德六世理工大学计算学院) IT:U Interdisciplinary Transformation University(IT:U跨学科转型大学) University of Augsburg(奥格斯堡大学)

AI总结 POLY-SIM 2026挑战赛旨在解决多模态说话者识别中语言和模态限制问题,针对实际应用中信息缺失、多语言等挑战,为比较解决方案提供标准化设置。

Comments Accepted at ACM MM 2026

详情
AI中文摘要

多模态说话者识别系统通常假设在训练和测试期间完整且同质的视听模态可用,且每个说话者只说一种语言。但在实际应用中这些假设往往不成立,视觉或音频信息可能缺失,多语言说话者也带来复杂性。POLY-SIM 2026挑战赛旨在解决这些问题,并为比较所提解决方案提供标准化设置。

英文摘要

Multimodal speaker identification systems typically assume the availability of complete and homogeneous audio-visual modalities during both training and testing, and assume each speaker only speaks a single language. However, in real-world applications, such assumptions often do not hold. Visual or audio information may be missing due to occlusions, camera or microphone failures, or privacy constraints. Multilingual speakers introduce additional complexity due to linguistic variability across languages. These situations constitute substantial challenges for the robustness and generalization capabilities of multimodal speaker identification systems. Aim of the POLY-SIM 2026 challenge is to address these aspects of speaker identification and to provide a standardized setup for the comparison of the proposed solutions.

URL PDF HTML 收藏
2607.13478 2026-07-16 cs.RO 新提交

VAMP-MR: Vector-Accelerated Motion Planning and Execution for Multi-Robot-Arms

VAMP-MR:多机器人手臂的向量加速运动规划与执行

Philip Huang, Chenrui Gao, Jiaoyang Li

机构 * Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所) University of Michigan(密歇根大学)

AI总结 针对多机器人手臂运动规划这一关键挑战,结合经典规划算法与矢量化碰撞检查技术,引入新运动规划器,基于CPU SIMD指令加速碰撞检查,在运动规划和执行后处理中实现加速,并发布实现降低研发门槛。

Comments 8 pages, 6 figures, 3 tables. To appear in the Proceedings of IROS 2026

详情
AI中文摘要

多机器人手臂运动规划是部署多个机械手执行制造等工业任务的关键挑战。现有的基于搜索和采样的求解器通常需要大量计算时间来生成适用于安全实际执行的无碰撞、高质量运动。在这项工作中,我们引入了一套新的多机器人手臂运动规划器,能够近乎实时地生成运动,将经典规划算法与先进的矢量化碰撞检查技术相结合。基于CPU SIMD指令,新规划器加速了主要瓶颈——碰撞检查,并在多臂操作任务的运动规划和执行后处理中实现了高达两个数量级的加速。我们还发布了实现,以降低多机器人手臂规划和操作问题的研发门槛。代码可在该https URL获取。

英文摘要

Multi-robot-arm motion planning is a key challenge in deploying multiple manipulators for industrial tasks such as manufacturing. Existing search-based and sampling-based solvers often require significant computation time to produce collision-free, high-quality motions suitable for safe real-world execution. In this work, we introduce a new suite of multi-robot-arm motion planners capable of near real-time motion generation, combining classical planning algorithms with state-of-the-art vectorized collision-checking techniques. Based on CPU SIMD instructions, our new planners accelerate their primary bottleneck, collision checking, and achieve up to two orders of magnitude speedup in both motion planning and execution postprocessing for multi-arm manipulation tasks. We also release our implementation to lower the barrier for research and development of multi-robot-arm planning and manipulation problems. Code is available at https://vamp-mr.github.io/vamp-mr

URL PDF HTML 收藏
2607.13337 2026-07-16 cs.RO 新提交

Design and Characterization of a Limb Encircling Actuator

肢体环绕式致动器的设计与特性

Japmanjeet Singh Gill, Gray Cortright Thomas, Nikko Van Crey, Roberto Leo Medrano, Elliott J. Rouse

机构 * University of Michigan(密歇根大学)

AI总结 研究重新思考致动几何结构使外骨骼更贴合身体的方法,开发肢体环绕式致动器(LEA)并表征其特性,其虽有高扭矩密度和创新布局,但贴近身体仍有困难,为外骨骼设计提供见解。

Comments 10 pages, 6 figures

详情
AI中文摘要

下肢动力外骨骼在移动性和功能方面有显著改善,但多数设计将致动部件置于腿部外侧或腰部、背部等远处。这些配置常超出身体自然范围,使设备在日常使用中具有侵入性,可能限制社会接受度。我们认为重新思考致动几何结构可使外骨骼更贴合身体。在此,我们探索了一种致动布局,致动器在与肢体轴正交的平面内环绕肢体,可能减少其在身体周围的空间占用。我们开发了肢体环绕式致动器(LEA),并使用定制测试平台对其机电特性进行了表征。LEA还具有一种新型径向轴承布局,有可能作为传统大直径轴承的轻量或低成本替代品。该致动器质量为894克,连续扭矩密度达到7.5 Nm/kg。尽管扭矩密度高且布局创新,但该系统仍难以贴近身体。这些结果突出了肢体环绕式致动的机遇与挑战,并为扭矩密集型外骨骼设计提供了见解,如果能克服致动器尺寸和几何结构方面的挑战,此类设计可更轻松地融入日常服装。

英文摘要

Lower-limb powered exoskeletons have demonstrated substantial improvements in mobility and function, but most designs place actuation components lateral to the legs or remotely at the waist or back. These configurations often extend beyond the body's natural envelope, making devices intrusive in everyday use and potentially limiting societal adoption. We posit that rethinking actuation geometry could enable exoskeletons that conform more closely to the body. Here, we explored an actuation layout in which the actuator encircles the limb in a plane orthogonal to the limb axis, potentially reducing its spatial footprint around the body. We developed the Limb-Encircling Actuator (LEA) and characterized its electromechanical properties using a custom-built testbed. The LEA also features a novel radial bearing layout with potential as a lightweight or lower-cost alternative to traditional large-diameter bearings. The actuator achieved a continuous torque density of 7.5 Nm/kg with a mass of 894 g. Despite this high torque density and innovative layout, the system remained difficult to contain close to the body. These results highlight opportunities and challenges in limb-encircling actuation and provide insights into torque-dense exoskeleton designs that could integrate more readily into everyday apparel if challenges in actuator sizing and geometry are overcome.

URL PDF HTML 收藏
2607.13241 2026-07-16 cs.LG cs.AI 新提交

EMAGN: Efficient Multi-Attention Graph Network via Learned Clustering for Scalable Traffic Forecasting

EMAGN:基于学习聚类的高效多注意力图网络用于可扩展交通流量预测

Mingxing Xu, Rakesh Chowdary Machineni, Ke Liu, Xi Cheng, Chengqi Lu, Xin Hu, Lyuhao Chen, Xiangyu Li, Junwei You, Oliver Gao

机构 * Shanghai Jiao Tong University(上海交通大学) University of Michigan, Ann Arbor(密歇根大学安娜堡分校) University of California, Berkeley(加利福尼亚大学伯克利分校) Cornell University(康奈尔大学) Technische Universität Dresden(德累斯顿工业大学) Carnegie Mellon University(卡内基梅隆大学) The University of Texas at Austin(德克萨斯大学奥斯汀分校) University of Wisconsin–Madison(威斯康星大学麦迪逊分校)

AI总结 针对交通流量预测中自注意力机制扩展性有限的问题,提出EMAGN,通过学习聚类矩阵将空间注意力机制线性化,降低复杂度,实验表明其在准确性和效率上优于其他模型,扩展了可行模型配置。

详情
AI中文摘要

交通流量预测因复杂的时空依赖性而极具挑战。自注意力机制虽被广泛采用以建模动态和长距离依赖性并取得了先进性能,但因二次计算和内存复杂度而扩展性有限。为此,我们提出了高效多注意力图网络(EMAGN),受快速高维高斯滤波理论启发,将空间注意力机制线性化。两个学习聚类矩阵C_k和C_v将键值向量自适应分组为M个超级聚类,把复杂度从O(N^2 d)降至O(NMd),且不牺牲动态依赖性建模的注意力灵活性。在PEMS - BAY和METR - LA上的实验结果表明,EMAGN在MAE上比全注意力GMAN低2.7 - 3.2%,同时训练时间减少32%,推理时间减少38%,GPU内存减少58%。在K = 16个注意力头时,全注意力GMAN在标准11GB GPU上完全耗尽内存,而EMAGN仍可运行,展示了可行模型配置的显著扩展。由于其交通网络感知的自适应聚类,EMAGN在相同骨干网络下在准确性和效率上也超过了Linformer和Performer。

英文摘要

Traffic forecasting is highly challenging due to complex and nonlinear spatial and temporal dependencies. Self-attention mechanisms have been widely adopted to model dynamic and long-range dependencies, achieving state-of-the-art performance, but suffer from limited scalability due to quadratic computational and memory complexity. To address this, we propose an Efficient Multi-Attention Graph Network (EMAGN) that linearises the spatial attention mechanism itself, inspired by the theory of fast high-dimensional Gaussian filtering. Two learned clustering matrices C_k and C_v adaptively group key and value vectors into M super-clusters, reducing complexity from O(N^2 d) to O(NMd) without sacrificing the flexibility of attention for dynamic dependency modelling. Experimental results on PEMS-BAY and METR-LA show that EMAGN achieves accuracy within 2.7-3.2% MAE of full-attention GMAN while reducing training time by 32%, inference time by 38%, and GPU memory by 58%. Critically, at K=16 attention heads, full-attention GMAN runs out of memory on a standard 11 GB GPU entirely while EMAGN continues to operate, demonstrating a categorical expansion of feasible model configurations. EMAGN also surpasses Linformer and Performer in both accuracy and efficiency within the same backbone, owing to its traffic-network-aware adaptive clustering.

URL PDF HTML 收藏
2601.02023 2026-07-16 cs.CL cs.AI 版本更新

Not All Needles Are Found: How Fact Distribution and Don't Make It Up Prompts Shape Retrieval, Reasoning, and Hallucination in Long-Context LLMs

并非所有线索都能被发现:事实分布和“不要编造”提示如何影响长上下文语言模型中的检索、推理和幻觉

Amirali Ebrahimzadeh, Seyyed M. Salili

机构 * Department of Electrical Engineering & Computer Science University of Michigan(电气工程与计算机科学系 密歇根大学)

AI总结 研究大语言模型中事实分布和反幻觉提示对检索、推理及幻觉的影响,通过扩展基准评估多个模型,识别出分布崩溃和安全代价两种失败模式,发现许多失败源于无效上下文利用,强调特定模型稳健性和上下文管理的重要性。

Comments 16 pages, 8 figures, 2 tables. Accepted at the FAGEN Workshop @ ICML 2026

详情
AI中文摘要

随着大语言模型(LLMs)越来越多地使用大规模上下文窗口作为自主任务的工作记忆,其可靠性会因信息在真实语料库中的分布方式而显著波动。我们通过引入一个为可扩展性设计的、与模型无关的扩展大海捞针基准来研究事实放置、语料库级分布和反幻觉(“不要编造”)提示如何影响模型行为,并将其应用于评估Gemini-2.5-flash、ChatGPT-5-mini、Claude-4.5-haiku和Deepseek-v3.2-chat。与先前工作不同,我们分别评估字面提取、逻辑推理和幻觉风险。我们识别出两种关键的失败模式:分布崩溃,即证据分散时性能显著下降;以及安全代价,即反幻觉提示导致对现有事实和证据过度保守地拒绝,大幅降低准确性。我们的结果表明,许多失败源于无效的上下文利用,因为即使相关信息存在,模型也难以对其进行优先排序。这些发现凸显了针对特定模型的稳健性和有效的上下文管理的必要性,以确保在长期代理工作流程中的可靠部署。

英文摘要

As Large Language Models (LLMs) increasingly utilize massive context windows as working memory for autonomous tasks, their reliability fluctuates significantly depending on how information is distributed in real-world corpora. We investigate how fact placement, corpus-level distributions, and anti-hallucination ("Don't Make It Up") prompts influence model behavior by introducing a model-agnostic extended needle-in-a-haystack benchmark designed for scalability, which we apply to evaluate Gemini-2.5-flash, ChatGPT-5-mini, Claude-4.5-haiku, and Deepseek-v3.2-chat. Unlike prior work, we separately evaluate literal extraction, logical inference, and hallucination risk. We identify two critical failure modes: Distributional Collapse, where performance degrades significantly when evidence is dispersed; and a Safety Tax, where anti-hallucination prompts cause over-conservative refusal of present facts and evidence, sharply reducing accuracy. Our results suggest that many failures stem from ineffective context utilization, as models struggle to prioritize relevant information even when it is present. These findings highlight the need for model-specific robustness and effective context management to ensure reliable deployment in long-horizon agentic workflows.

URL PDF HTML 收藏
2607.12114 2026-07-15 cs.RO cs.AI cs.CV 新提交

GaitSpan: Growing Humanoid Locomotion from Walking to Running

GaitSpan:将类人机器人的运动从行走扩展到跑步

Kwan-Yee Lin, Zilin Wang, Janelle J. Liu, Stella X. Yu

机构 * University of Michigan(密歇根大学) UC Berkeley(加州大学伯克利分校)

AI总结 研究如何让类人机器人从行走扩展到跑步,提出GaitSpan框架,将预训练行走策略扩展,通过节奏生成、步幅塑造和残差适应三方面实现,能跨形态、跨地形零样本部署,相比基线学习更快且步态性能更强。

Comments Project Page: https://gaitspan2026.github.io/

详情
AI中文摘要

一个能行走的类人机器人不应从头开始重新学习慢跑或跑步的运动。当前方法通常通过规定步态计划、模仿运动片段、训练专家切换或提炼技能为单一策略来获得步态多样性。这些策略虽能产生令人印象深刻的行为,但在连续速度指令、地形和形态方面灵活性有限。我们用GaitSpan研究技能增长,它将预训练的基本行走策略扩展为更快的运动。它把行走视为种子技能,可在新节奏下再生、扩展步幅并通过残差适应修正。这种扩展有节奏生成、步幅塑造和残差适应三个方面。GaitSpan首次提供了一个单一的指令条件类人机器人策略,涵盖行走、慢跑和类似跑步的状态,跨形态转移,并能在未见的模拟到模拟和真实世界地形上零样本部署。与多专家训练或人类模仿的基线相比,它学习更快,步态性能更强。

英文摘要

A humanoid that can walk should not relearn locomotion from scratch to jog or run. Yet current approaches often obtain gait diversity by prescribing gait schedules, imitating motion clips, training experts to switch between or distilling skills into one policy. These strategies can produce impressive behaviors, but offer limited flexibility across continuous speed commands, terrains, and morphologies. We study skill growth with GaitSpan, a framework that expands a pretrained, basic walking policy into faster locomotion. It treats walking as a seed skill: reusable motor structure for balance, support, body coordination, and contact transition that can be regenerated at new rhythms, extended into longer/higher strides, and corrected by residual adaptation. This expansion has three aspects: 1) rhythm generation, which modulates the frozen walking policy with multiple internal clocks and learns command-conditioned combinations of the resulting canonical actions; 2) stride shaping, which rewards dynamic locomotion patterns appropriate for higher commanded speeds using a physically grounded objective inspired by spring-loaded inverted pendulum dynamics; and 3) residual adaptation, which captures motion details not accounted for by rhythm generation or stride shaping. GaitSpan is the first to deliver a single command-conditioned humanoid policy that spans walking, jogging, and running-like regimes covering a continuous speed range, transfers across morphologies, and deploys zero-shot on unseen sim-to-sim, and real-world terrains. Compared with baselines either trained with multi-experts or imitation from humans, it learns faster and achieves stronger gait performance.

URL PDF HTML 收藏
2607.11964 2026-07-15 cs.LG 新提交

LIDAR-AD: A Decoder-Free Latent-Interaction Dreamer with Action-Residual Chains for Autonomous Driving

LIDAR-AD:一种用于自动驾驶的无解码器潜在交互梦想家与动作残差链

Yongzhi Liu, Yang Xiao, Zhong Cao, Zeng Kang, Sunan Zhang, Zhaozhi Dong, Guojun Yu, Weichao Zhuang

机构 * School of Mechanical Engineering, Southeast University(东南大学机械工程学院) Department of Civil and Environmental Engineering, University of Michigan(密歇根大学土木与环境工程系) Xheart Technology Co., Ltd.(芯驰科技有限公司)

AI总结 研究针对自动驾驶中多源观测冗余问题,提出LIDAR-AD,用减少冗余的潜在对齐取代观测重建,将车辆控制建模为残差动作更新,经实验验证其在模拟场景和现实布局下性能优异,能提升风险感知等能力。

详情
AI中文摘要

自动驾驶需要在动态交通环境中进行长距离闭环决策。潜在世界模型通过在紧凑潜在空间中实现基于想象的决策,为该问题提供了一个有效框架。然而,多源观测包含与控制无关的冗余,而可靠的驾驶决策依赖于与风险相关的关系、未来动态和连续动作调整。这种不匹配使得观测重建和绝对动作建模在学习与决策相关的潜在动态方面次优。我们提出了LIDAR-AD,一种用于自动驾驶的无解码器潜在交互梦想家与动作残差链。LIDAR-AD用减少冗余的潜在对齐取代观测重建,鼓励在多源驾驶输入中紧凑表示与风险相关的关系。它进一步将车辆控制建模为残差动作更新,并使用残差动作序列对比学习将多步残差驱动的展开与未来潜在状态对齐。确定性分析表明,潜在双曲正切残差参数化在保持内部动作可达性的同时,将平滑的长距离控制表示为紧凑的局部更新。这些设计共同改进了风险感知状态抽象、连续控制建模和长距离动态预测。在各种模拟驾驶场景下的广泛实验表明,LIDAR-AD始终优于世界模型基线,在基于学习的方法中实现了最高奖励和最佳成功率。对nuPlan衍生的日志重建场景的评估进一步证明了LIDAR-AD在现实世界交通布局下的可转移性。

英文摘要

Autonomous driving requires long-horizon closedloop decision making in dynamic traffic environments. Latent world models offer an effective framework for this problem by enabling imagination-based decision making in compact latent spaces. However, multi-source observations contain controlirrelevant redundancy, whereas reliable driving decisions rely on risk-relevant relations, future dynamics, and continuous action adjustments. This mismatch makes observation reconstruction and absolute action modeling suboptimal for learning decisionrelevant latent dynamics. We propose LIDAR-AD, a decoderfree Latent-Interaction Dreamer with Action-Residual Chains for autonomous driving. LIDAR-AD replaces observation reconstruction with redundancy-reduced latent alignment, encouraging compact representations of risk-relevant relations in multi-source driving inputs. It further models vehicle control as residual action updates and uses residual-action sequence contrastive learning to align multi-step residual-driven rollouts with future latent states. A deterministic analysis shows that the latent-tanh residual parameterization preserves interior action reachability while representing smooth long-horizon control as compact local updates. Together, these designs improve risk-aware state abstraction, continuous-control modeling, and long-horizon dynamics prediction. Extensive experiments across diverse simulated driving scenarios demonstrate that LIDAR-AD consistently outperforms world-model baselines, achieving the highest reward and the best success rate among learning-based methods. Evaluations on nuPlan-derived log-reconstructed scenarios further demonstrate the transferability of LIDAR-AD under real-world traffic layouts.

URL PDF HTML 收藏
2602.15892 2026-07-15 cs.CV cs.AI 版本更新

Egocentric Bias in Vision-Language Models

视觉语言模型中的自我中心偏差

Maijunxian Wang, Yijiang Li, Bingyang Wang, Tianwei Zhao, Ran Ji, Qingying Gao, Emmy Liu, Hokin Deng, Dezhi Luo

机构 * Cognitive Science Program, University of California, Berkeley(加州大学伯克利分校认知科学项目) Department of Electrical and Computer Engineering, University of California San Diego(加州大学圣地亚哥分校电气与计算机工程系) School of Computer Science, Georgia Institute of Technology & Emory University(佐治亚理工学院计算机科学学院及埃默里大学) Department of Computer Science, Johns Hopkins University(约翰霍普金斯大学计算机科学系) Department of Cognitive Science, University of California San Diego(加州大学圣地亚哥分校认知科学系) Equal Advising Department of Computer Science & Wilmer Eye Institute, Johns Hopkins University(约翰霍普金斯大学计算机科学系及威尔默眼科研究所) Language Technologies Institute, Carnegie Mellon University(卡内基梅隆大学语言技术研究所) Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所) Weinberg Institute for Cognitive Science, University of Michigan(密歇根大学韦恩伯格认知科学研究所)

AI总结 本文提出FlipSet基准,揭示视觉语言模型在第二级视觉视角推理中存在系统性自我中心偏差,表明模型在整合社会认知与空间操作方面存在根本性不足。

Comments Accepted at CogSci 2026 (Best Undergraduate Student Paper)

详情
AI中文摘要

视觉视角的推理——推断从他人视角世界如何呈现——是社会认知的基础。我们引入FlipSet,一个用于评估视觉语言模型中第二级视觉视角推理(L2 VPT)的诊断基准。该任务要求模拟从另一个代理视角对二维字符字符串进行180度旋转,隔离空间变换与三维场景复杂性。评估103个VLMs发现系统性的自我中心偏差:绝大多数表现低于随机水平,其中约四分之三的错误重现了摄像机视角。控制实验揭示了组合缺陷——模型在孤立情况下实现高理论-心准确率和高于随机水平的内部旋转,但当需要整合时却彻底失败。这种分离表明当前VLMs缺乏将社会意识与空间操作结合的机制,暗示了基于模型的空间推理的根本限制。FlipSet为多模态系统诊断视角推理能力提供了认知基础的测试平台。

英文摘要

Visual perspective taking--inferring how the world appears from another's viewpoint--is foundational to social cognition. We introduce FlipSet, a diagnostic benchmark for Level-2 visual perspective taking (L2 VPT) in vision-language models. The task requires simulating 180-degree rotations of 2D character strings from another agent's perspective, isolating spatial transformation from 3D scene complexity. Evaluating 103 VLMs reveals systematic egocentric bias: the vast majority perform below chance, with roughly three-quarters of errors reproducing the camera viewpoint. Control experiments expose a compositional deficit--models achieve high theory-of-mind accuracy and above-chance mental rotation in isolation, yet fail catastrophically when integration is required. This dissociation indicates that current VLMs lack the mechanisms needed to bind social awareness to spatial operations, suggesting fundamental limitations in model-based spatial reasoning. FlipSet provides a cognitively grounded testbed for diagnosing perspective-taking capabilities in multimodal systems.

URL PDF HTML 收藏
2506.12339 2026-07-15 cs.HC cs.AI 版本更新

SheetMind: An End-to-End LLM-Powered Multi-Agent Framework for Spreadsheet Automation

SheetMind:一个由端到端大语言模型驱动的用于电子表格自动化的多智能体框架

Xi Cheng, Ruiyan Zhu, Ke Liu, Rakesh Chowdary Machineni, Lyuhao Chen, Brian Zhu, Daniel Jin, Zheng Qi, Neeraj Parihar, Zhoutian Xu, Oliver Gao

机构 * Cornell University(康奈尔大学) University of California, Berkeley(加州大学伯克利分校) University of Michigan(密歇根大学) Carnegie Mellon University(卡内基梅隆大学) Hong Kong University of Science and Technology (GZ)(香港科学与技术大学)

AI总结 介绍由大语言模型驱动的多智能体框架SheetMind用于电子表格自动化,其分层系统含三个智能体,经评估在SheetCopilot基准测试中执行成功率达100%、功能正确性54.8%超对手,消融研究验证配置优势,还集成到谷歌表格。

详情
AI中文摘要

我们展示了SheetMind,这是一个由大语言模型驱动的模块化多智能体框架,用于通过自然语言指令实现电子表格自动化。本文介绍了一个分层智能体系统,它由三个专门的智能体组成:负责将复杂用户指令分解为子任务的管理智能体;使用巴科斯范式(BNF)语法将这些指令转换为结构化命令的行动智能体;以及验证生成动作与用户原始意图之间一致性的反思智能体。我们使用GPT-3.5-Turbo在221个任务的SheetCopilot基准测试中对SheetMind进行评估。SheetMind实现了100%的执行成功率和54.8%的功能正确性,超过了SheetCopilot(44.3%),同时保持了完美的执行可靠性。我们还在一个单独策划的数据集上进行了消融研究,以确认完整的三智能体配置始终优于所有部分变体。最后,我们通过Workspace扩展将我们的系统集成到谷歌表格中。

英文摘要

We present SheetMind, a modular multi-agent framework powered by large language models (LLMs) for spreadsheet automation via natural language instructions. In this paper, we introduce a hierarchical agentic system consisting of three specialized agents: Manager Agent that decomposes complex user instructions into subtasks; an Action Agent that translates these into structured commands using a Backus-Naur Form (BNF) grammar; and a Reflection Agent that validates alignment between generated actions and the user's original intent. We evaluate SheetMind on the 221-task SheetCopilot Benchmark with GPT-3.5-Turbo. SheetMind achieved 100% execution success and 54.8% functional correctness, exceeding SheetCopilot (44.3%) while maintaining perfect execution reliability. We also conduct ablation study on a separately curated dataset to confirm that the full three-agent configuration consistently outperforms all partial variants. Lastly, we integrate our system into Google Sheets via a Workspace extension.

URL PDF HTML 收藏
2607.11871 2026-07-14 cs.LG cs.AI cs.CL 新提交

Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Bias

剖析不公平的评判者:基于大语言模型作为评判者的偏差的机械可解释性分析

Zixiang Xu, Sixian Li, Huaxing Liu, Xiang Wang, Shuai Li, Zirui Song, Xiuying Chen

机构 * AMAP, Alibaba Group(阿里巴巴集团AMAP实验室) Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学) University of Southern California(南加州大学) University of Michigan, Ann Arbor(密歇根大学安娜堡分校)

AI总结 研究大语言模型作为评判者的偏差,提出偏差在隐藏状态有表示层面解释。通过七位评判者等实验发现,偏差输入沿特定子空间移动,操纵隐藏状态可控制评分,线性投影能预测评判失败,统一多方面内容。

Comments 58 pages, 13 figures, 30 tables; project page: https://xzx34.github.io/unfair-judge/

详情
AI中文摘要

现有的关于大语言模型作为评判者评分偏差的研究主要在输入-输出层面进行:扰动输入、测量分数变化并提出提示级别的缓解措施。我们认为,同样的偏差在评判者的隐藏状态中存在一种表示层面的解释,它与输入-输出观点互补,并且在操作上具有实用价值。我们报告了三项发现,涉及七位评判者、七种偏差类型和九个基准。几何学方面:基线评判输入占据一个紧密的激活流形,而有偏差的输入则沿着一个低维的、特定类型的子空间移动,该子空间随深度而锐化,并能被三类估计器一致地恢复。因果控制方面:沿着这个子空间操纵隐藏状态会在两个方向上驱动评分,正向移动在干净输入上重现偏差评分,反向移动在有偏差的输入上恢复基线评分,而匹配范数的随机方向产生的移动则小一个数量级。操作方面:在相同偏差方向特征上的简单线性投影能够预测在三个完全未见过的基准上的评判失败,显著优于基于文本的替代方法。将偏差视为激活几何学,而非输入-输出噪声,在一个单一框架内统一了几何结构、因果控制和操作预测。项目页面可在这个https链接获取。

英文摘要

Existing studies of LLM-as-judge scoring bias work predominantly at the input-output level: they perturb inputs, measure score deltas, and propose prompt-level mitigations. We argue that the same biases admit a representation-level account in the judge's hidden state, complementary to the input-output view and operationally useful in ways it does not afford. We report three findings, across seven judges, seven bias types, and nine benchmarks. Geometry: baseline judging inputs occupy a tight activation manifold while biased inputs are displaced along a low-dimensional, type-specific subspace that sharpens with depth and is recovered consistently by three families of estimators. Causal control: steering hidden states along this subspace drives scoring in both directions, forward shifts reproducing biased scoring on clean inputs and reverse shifts restoring baseline scoring on biased ones, while matched-norm random directions produce shifts an order of magnitude smaller. Operational: a simple linear projection onto the same bias-direction features anticipates judge failures on three entirely unseen benchmarks, substantially outperforming text-based alternatives. Reading bias as activation geometry, rather than as input-output noise, unifies geometric structure, causal control, and operational prediction within a single framework. The project page is available at https://xzx34.github.io/unfair-judge/

URL PDF HTML 收藏
2607.11736 2026-07-14 cs.CL 新提交

MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoning

MET:基于理论和文化感知的多语言道德推理

Ayoung Lee, Ryan Kwon, Yunxiang Zhang, Yuxuan Liu, Peter Railton, Lu Wang

机构 * University of Michigan(密歇根大学)

AI总结 研究针对语言模型用于跨语言文化道德决策时存在的多语言性忽视问题,提出MET两步提示法及MET-D自我蒸馏训练,引入MCLASH基准,实验表明MET-D提升模型性能,揭示不同文化有益依据差异,为多语言道德推理开辟道路。

Comments Published as a conference paper at COLM 2026

详情
AI中文摘要

语言模型越来越多地用于跨语言和文化背景的道德决策,但现有工作在三个方面忽视了多语言性:多语言评估基准使用直接翻译,未能适应特定文化项目;道德推理的推理时间方法依赖于静态的、以英语为中心的框架,缺乏道德理论基础;道德决策的训练方法通常需要来自更强模型或人类注释者的昂贵监督。我们通过三项贡献解决了这些差距。首先,我们引入了MCLASH,这是一个多语言道德决策基准,以捕捉跨语言的文化情境化道德直觉和社会规范。其次,我们提出了MET(基于理论推理的多语言伦理学),这是一种两步提示方法,基于从心理学和哲学中提取的专家策划、基于理论的依据:模型首先选择特定情境和文化的依据,然后用用户的母语对其进行推理。第三,我们引入了MET-D(MET蒸馏),它通过一个不需要外部监督的自我蒸馏训练阶段来增强第二步。MET-D在不同大小和家族的所有三个模型(Qwen3-4B、Qwen3-8B、Gemma3-4B)上的宏观F1均优于基础模型,在MCLASH上平均提高3.71分,在MMoralExceptQA上提高4.23分,Qwen3-8B上马来语的MCLASH增益峰值为12.94分。我们进一步揭示,MET-D平均增加了62.13分的母语推理,并且有益的依据在不同文化中系统地不同。总之,这些贡献为文化对齐、基于理论的多语言道德推理开辟了道路。

英文摘要

Language models are increasingly used for moral decision-making across diverse linguistic and cultural contexts, yet existing work overlooks multilinguality on three aspects: 1) multilingual evaluation benchmarks use direct translation, failing to adapt culture-specific items; 2) inference-time methods for moral reasoning rely on static, English-centric scaffolds and lack grounding in moral theory; 3) training methods for moral decision-making typically require expensive supervision from stronger models or human annotators. We address these gaps with three contributions. First, we introduce MCLASH, a multilingual moral decision-making benchmark to capture culturally situated moral intuitions and social norms across languages. Second, we propose MET (Multilingual Ethics with Theory-grounded reasoning), a two-step prompting method built on expert-curated, theory-based grounds drawn from psychology and philosophy: the model first selects situation- and culture-specific grounds, then reasons over them in the native language of the user. Third, we introduce MET-D (MET-Distillation), which enhances the second step through a self-distillation training stage that requires no external supervision. MET-D improves macro-F1 over the base model on all three models of different sizes and families (Qwen3-4B, Qwen3-8B, Gemma3-4B), by an average of 3.71 points on MCLASH and 4.23 on MMoralExceptQA, with a peak MCLASH gain of 12.94 points for Malay on Qwen3-8B. We further reveal that MET-D increases native-language reasoning by 62.13 points on average, and that beneficial grounds differ systematically across cultures. Together, these contributions open the path for culture-aligned, theory-grounded multilingual moral reasoning.

URL PDF HTML 收藏
2607.11091 2026-07-14 cs.LG q-bio.BM stat.ML 新提交

Adapting Evidential Neural Networks to Test-Time Neighbor Fusion Improves Molecular Property Prediction

使证据神经网络适应测试时的邻居融合可改善分子性质预测

Cameron Gruich, Weichi Yao, Yixin Wang, Bryan Goldsmith

机构 * Department of Chemical Engineering, University of Michigan(美国密歇根大学化学工程系) Michigan Institute for Data & AI in Society, University of Michigan(美国密歇根大学数据与社会人工智能研究所) Department of Statistics, University of Michigan(美国密歇根大学统计系)

AI总结 研究如何利用证据神经网络在测试时通过邻居融合优化分子性质预测,提出PG-EVIKAL方法,学习性质距离度量重排邻居,经实验验证该方法能降低RMSE、改善校准,还能在连续测定场景中优化预测,证明证据不确定性分解可用于测试时分子性质预测优化。

Comments 45 pages (18 main, 27 SI); 11 figures (7 main, 4 SI); 14 tables (0 main, 14 SI); 61 equations (15 main, 46 SI)

详情
AI中文摘要

一个经过训练的分子性质模型可以在测试时通过用最相似训练分子的测量标签校正每个预测来进行优化,这是一种无需重新训练的过程,我们称之为邻居融合;证据神经网络通过使用其偶然和认知不确定性对贝叶斯更新进行参数化,使其具有原则性。我们的主要贡献PG-EVIKAL,基于EVIKAL(标量卡尔曼滤波器)和GP-EVIKAL(处理相关邻居的高斯过程变体),学习一种性质距离度量,以便在融合前按性质相关性对结构相似的邻居重新排序。在16个分子数据集上评估,PG-EVIKAL相对于证据模型基线在其中14个数据集上降低了RMSE,中位数降低了19.4%,并改善了校准;在连续测定场景中,它进一步纳入新测量的分子,在不重新训练的情况下随着预测的到来进行优化。这项工作表明,证据不确定性分解不仅是一个校准目标,而且是一种可操作的推理资源,能够在测试时优化分子性质预测。

英文摘要

A trained molecular property model can be refined at test time by correcting each prediction with the measured labels of the most similar training molecules, a retraining-free procedure we call neighbor fusion; evidential neural networks make it principled by using their aleatoric and epistemic uncertainty to parameterize a Bayesian update. Our main contribution, PG-EVIKAL, learns a property-distance metric to re-rank structurally similar neighbors by their property relevance before fusion, building on EVIKAL (scalar Kalman filter) and GP-EVIKAL (Gaussian process variant handling correlated neighbors). Evaluated on 16 molecular datasets, PG-EVIKAL reduces RMSE relative to the evidential model baseline on 14 of them, with a median reduction of 19.4%, and improves calibration; in sequential-assay scenarios it further incorporates newly measured molecules, refining predictions as they arrive without retraining. This work demonstrates that evidential uncertainty decomposition is not merely a calibration objective but an actionable inference resource that enables test-time refinement of molecular property predictions.

URL PDF HTML 收藏