arXivDaily arXiv每日学术速递 周一至周五更新

高校专区

University of Southern California(南加州大学)

至 收录 1120
2607.17627 2026-07-21 cs.HC cs.CL 新提交

It Matters How You Say It: Exploring Rhetorical Patterns for AI-Assisted Information Evaluation

表达方式很重要:探索用于人工智能辅助信息评估的修辞模式

Sadra Sabouri, Zeinabsadat Saghi, Jordan Lee Boyd-Graber, Jonathan May, Jonathan K. Kummerfeld, Souti Chattopadhyay

机构 * Department of Computer Science, University of Southern California(计算机科学系,南加州大学) Department of Computer Science, University of Maryland(计算机科学系,马里兰大学) Information Sciences Institute, University of Southern California(信息科学研究所,南加州大学) School of Computer Science, University of Sydney(计算机科学学院,悉尼大学)

AI总结 研究人工智能辅助信息评估中修辞模式,通过主体内研究考察八种修辞模式,发现支架式解释与最高准确率提升相关,对抗条件也能适度提高准确率,还探讨了设计不同修辞风格对话代理的意义及相关权衡。

Comments 13 pages, 6 figures, 1 table

详情
AI中文摘要

先前关于人工智能辅助信息评估的工作主要集中在人工智能系统传达的内容上,比较解释类型和格式,其回应主要采用指令性修辞,即系统给出裁决,用户被动接受。虽然辩论式互动最近在促使批判性评估而非顺从方面显示出前景,但构建人工智能回应的修辞模式以及它们如何引发反思、不确定性或独立推理在很大程度上仍未得到研究。为解决此问题,我们研究了八种已知能引发思考的修辞模式:故意误导、解释性替代、支架式解释、引发不信任、信息扭曲、另类框架、苏格拉底式提问以及神谕基线。通过对98名参与者进行的关于按需提示事实核查任务的主体内研究,我们观察到初步证据表明支架式解释与最高的准确率提升相关,并鼓励更深入的反思。令人惊讶的是,对抗条件也适度提高了准确率。参与者最喜欢另类框架,最不喜欢解释性替代,主要是因为后者的时间成本较高。我们讨论了设计具有不同修辞风格的对话代理的意义以及在用户表现、满意度和思考之间的权衡。

英文摘要

Prior work on AI-assisted information evaluation has largely focused on what AI systems communicate, comparing explanation types and formats, with responses predominantly cast in directive rhetoric where the system delivers a verdict and the user passively accepts it. While debate-style interactions have recently shown promise in prompting critical evaluation over deference, the rhetorical patterns that structure AI responses and how they might induce reflection, uncertainty, or independent reasoning remain largely unexamined. To address this, we investigated eight rhetorical patterns known to induce contemplation: Intentional Misleading, Interpretive Alternative, Scaffold Explanation, Triggering Distrust, Information Distortion, Alternative Framing, Socratic Questioning, and an Oracle baseline. Through a within-subject study with n=98 participants on a hint-on-demand fact verification task, we observed preliminary evidence that Scaffold Explanation were associated with the highest accuracy gains, and encouraging deeper reflection. Surprisingly, the adversarial conditions also improved accuracy modestly. Participants preferred Alternative Framing most and Interpretive Alternative least, largely due to the latter's perceived time cost. We discuss the implications of designing conversational agents with varied rhetorical styles and the trade-offs among user performance, satisfaction, and contemplation.

URL PDF HTML 收藏
2607.17601 2026-07-21 cs.LG cs.AI 新提交

Trustworthy Protein-Ligand Binding Affinity Prediction via Reliability-Aware Multi-Engine Fusion

通过可靠性感知多引擎融合实现可靠的蛋白质-配体结合亲和力预测

Yongchan Hong, Defu Cao, Wenjin Liu, Thomas Ku, Jordy Homing Lam, Emily Nguyen, Willie Neiswanger, Vsevolod Katritch, Yan Liu

机构 * University of Southern California(南加州大学) University of California, Berkeley(加州大学伯克利分校)

AI总结 研究针对蛋白质-配体结合亲和力预测中引擎结果不一致问题,提出RELIABLE-BA框架,通过三步实现多引擎预测,经实验验证其能提升预测竞争力和不确定性校准,可筛选高置信对减少误差,是首个结合证据融合与上下文可靠性的预测框架。

详情
AI中文摘要

准确的蛋白质-配体结合亲和力预测是计算药物发现的核心,但现代对接引擎常常给出不一致的结果且无置信度指示。共识评分和集成方法虽提高了平均准确率,但未考虑化学背景。为此提出RELIABLE-BA框架,通过三步实现多引擎结合亲和力预测:将各引擎建模为证据专家,根据分子背景缩放认知不确定性并保留预测均值,通过闭式聚合融合专家。实验表明该方法有竞争力且不确定性校准显著改善,能可靠筛选蛋白质-配体对,减少预测误差。这也是首个将证据融合与上下文相关可靠性结合的多引擎预测框架,为可信AI指导药物发现提供了原则性路径。

英文摘要

Accurate protein-ligand binding affinity prediction is central to computational drug discovery, yet modern docking engines frequently disagree without indicating which prediction to trust. Consensus scoring and ensemble methods improve mean accuracy but treat all predictions identically without interpretable confidence measures or uncertainty decomposition, ignoring the chemical context of each protein-ligand pair. To address this limitation, we introduce RELIABLE-BA (RELIABiLity-aware Evidential fusion for Binding Affinity), an evidential framework for multi-engine binding affinity prediction. Our model comprises three steps: (1) modeling each engine as an evidential expert via Normal-Inverse-Gamma distributions, (2) scaling epistemic uncertainty through learned reliability from molecular context while preserving each expert's predictive mean, and (3) fusing experts through closed-form aggregation that captures both individual uncertainty and inter-engine disagreement. Experiments on the PDBBind and BDB2020+ benchmarks demonstrate competitive point prediction with substantially improved uncertainty calibration, and additional validation on the SARS-CoV-2 Mpro dataset and 5HT2A receptor demonstrates applicability to clinically relevant drug targets. Crucially, these uncertainty estimates enable reliable filtering of protein-ligand pairs, reducing prediction error by up to 25% when retaining only high-confidence pairs. To our knowledge, RELIABLE-BA is the first multi-engine binding affinity prediction framework to combine evidential fusion with context-dependent reliability, offering a principled path toward trustworthy AI-guided drug discovery. Our code is publicly available at https://github.com/yongchand/RELIABLE-BA.

URL PDF HTML 收藏
2607.17570 2026-07-21 cs.LG 新提交

A Weisfeiler-Leman Characterization of Global-Attention Graph Transformers for Mixed-Integer Linear Programs

用于混合整数线性规划的全局注意力图变换器的Weisfeiler-Leman特征

Md Abrar Jahin, Craig A. Knoblock, Jay Pujara

机构 * University of Southern California(南加州大学) USC Information Sciences Institute(南加州大学信息科学研究所)

AI总结 研究通过图同构测试,探讨具有全局注意力的图基础模型对混合整数线性规划的表达能力,证明一类分层图变换器受1-WL测试限制,验证多种图编码器,表明超越其表达能力源于输入编码,提供与编码器无关的诊断方法。

Comments Accepted to Topology, Algebra, and Geometry in Data Science (TAG-DS) 2026 (20 pages, 10 figures) [Lightning Oral Presentation]

详情
AI中文摘要

具有全局注意力的图基础模型(GFMs)越来越多地用于表示混合整数线性规划(MILPs),旨在捕捉超越标准图神经网络局部性的结构。我们通过图同构测试研究它们的表达能力,询问哪些MILP实例会映射到相同的表示。我们证明,一类广泛的分层图变换器,结合全局线性注意力、边加权交叉注意力和二分消息传递,受一维Weisfeiler-Leman(1-WL)测试的限制:在任何参数设置下,1-WL等效的MILP图会接收相同的图嵌入。我们的组合证明表明,每个架构组件都是一个对称多重集函数,因此保留1-WL等效性。我们在十种不同的图编码器上验证了这一特征,包括Graphormer、GraphGPS、Set-Transformer和Gasse风格的模型。在模型容量、图规模和池化算子方面,每个测试编码器都将1-WL等效的非同构图对映射到数值相同的嵌入。因此,无法从这些表示中恢复在1-WL等效类中变化的图不变量。我们进一步表明,超越1-WL的表达能力来自输入编码而非注意力:随机游走位置编码分离了构造的对,而其他构造揭示了这种补救方法的局限性。这些结果表征了全局注意力GFMs的表达能力,并为检测1-WL诱导的表示等效性提供了一种与编码器无关的诊断方法。

英文摘要

Graph foundation models (GFMs) with global attention are increasingly used to represent mixed-integer linear programs (MILPs), aiming to capture structure beyond the locality of standard graph neural networks. We study their expressive power through graph isomorphism testing, asking which MILP instances they map to identical representations. We prove that a broad class of hierarchical graph transformers combining global linear attention, edge-weighted cross-attention, and bipartite message passing is bounded by the one-dimensional Weisfeiler-Leman (1-WL) test: under any parameter setting, 1-WL-equivalent MILP graphs receive identical graph embeddings. Our compositional proof shows that each architectural component is a symmetric multiset function and thus preserves 1-WL equivalence. We validate this characterization across ten diverse graph encoders, including Graphormer-, GraphGPS-, Set-Transformer-, and Gasse-style models. Across model capacities, graph scales, and pooling operators, every tested encoder maps 1-WL-equivalent non-isomorphic graph pairs to numerically identical embeddings. Consequently, graph invariants that vary within a 1-WL equivalence class cannot be recovered from these representations. We further show that expressiveness beyond 1-WL arises from input encoding rather than attention: random-walk positional encodings separate the constructed pairs, while additional constructions expose the limits of this remedy. These results characterize the expressive power of global-attention GFMs and provide an encoder-agnostic diagnostic for detecting 1-WL-induced representation equivalence.

URL PDF HTML 收藏
2607.17524 2026-07-21 cs.CL cs.LG 新提交

Token-Level Off-Policy Learning for Faithful Generation Under Distribution Shift

分布转移下忠实生成的令牌级离策略学习

Zitong Huang, Gustavo Lucas Carvalho, Deqing Fu, Robin Jia

机构 * University of Southern California(南加州大学)

AI总结 研究分布转移下忠实生成问题,提出令牌级离策略标注(TOPL)方法,通过训练模型区分响应中好坏令牌引导生成,在文档摘要等任务实验中实现强大分布外泛化,能有效转移到机器翻译,且学习信号关键,更新具可解释性。

详情
AI中文摘要

我们提出了令牌级离策略标注(TOPL),这是一种离策略训练范式,将训练后重新构建为令牌级正确性预测任务。我们的关键直觉是,通过训练模型区分响应中的好令牌和坏令牌,自然地引导模型生成好令牌,同时避免直接训练模型生成离策略令牌带来的陷阱。在文档摘要任务上的实验表明,TOPL在11个数据集上相对于各种序列级和令牌级基线实现了强大的分布外泛化。我们进一步证明TOPL能有效转移到机器翻译,表明其好处能推广到不同的忠实生成任务。通过消融研究,我们确认令牌级学习信号对良好性能至关重要;序列级类似物没有类似好处。最后,我们表明TOPL能诱导可解释的模型更新:通过TOPL学习的LoRA适配器充当线性分类头和引导向量。

英文摘要

We propose Token-Level Off-Policy Labeling (TOPL), an off-policy training paradigm that reframes post-training as a token-level correctness prediction task. Our key intuition is that by training the model to distinguish good and bad tokens in a response, we naturally guide the model towards generating good tokens, while avoiding the pitfalls that come with directly training the model to generate off-policy tokens. Experiments on document summarization tasks show that TOPL achieves strong out-of-distribution generalization across 11 datasets against a diverse set of sequence-level and token-level baselines. We further demonstrate that TOPL transfers effectively to machine translation, suggesting that its benefits generalize across different faithful generation tasks. Through ablation studies, we confirm that our token-level learning signal is critical to good performance; sequence-level analogues do not confer similar benefits. Finally, we show that TOPL induces interpretable model updates: the LoRA adapters learned through TOPL function as linear classification heads and steering vectors.

URL PDF HTML 收藏
2607.16921 2026-07-21 cs.RO cs.AI 新提交

PREFAIL: Identifying Precursors to Failures in Robotic Lift-and-Place Tasks to Improve Task Execution Performance

PREFAIL:识别机器人提升和放置任务中故障的先兆以提高任务执行性能

Zeyu Shangguan, Rajas Chitale, Rutvik Patel, Satyandra K. Gupta, Daniel Seita

机构 * University of Southern California(南加州大学)

AI总结 研究非prehensile物料搬运的提升和放置任务,提出PREFAIL方法通过分析目标物体与载体相对运动预测故障先兆,引入精确标识最新干预时间的数据集,经实验验证该方法显著提升故障先兆响应的准确性与及时性。

详情
AI中文摘要

非prehensile操作可通过零件载体实现灵活的物料搬运,但基于摩擦的支撑使高速运动容易出现故障,而较慢的操作会增加周期时间。因此,主动故障预测对于高效可靠的性能至关重要,但现有方法仍受到关键限制,包括对动态动作的敏感性和对已知策略结构的高度依赖。此外,现有方法和数据集缺乏对最新干预时间的精确表征,不清楚检测到的故障是否仍可通过及时干预来预防。在本文中,我们研究了用于非prehensile物料搬运操作的提升和放置任务,并通过分析目标物体相对于载体的相对运动,提出了一种更有效的方法来预测故障先兆(PREFAIL)。我们还引入了一个数据集,该数据集精确识别了危险操作的最新干预时间,从而能够严格评估故障预测是否可行。我们在模拟和真实世界数据集上验证了我们的方法。实验结果表明,PREFAIL大大提高了对故障先兆响应的准确性和及时性。

英文摘要

Non-prehensile manipulation enables flexible material handling with part carriers, but friction-based support makes high-speed motions failure-prone, while slower operation increases cycle time. Proactive failure prediction is therefore essential for efficient and reliable performance, yet existing approaches remain limited by key constraints, including sensitivity to dynamic actions and high dependence on known policy structures. Furthermore, existing methods and datasets lack a precise characterization of the latest intervention time, leaving it unclear whether a detected failure can still be prevented through timely intervention. In this paper, we investigate lift-and-place tasks for non-prehensile material handling manipulation and propose a more effective approach to predicting precursors to failures (PREFAIL) by analyzing the relative motion of target objects with respect to the carrier. We further introduce a dataset that precisely identifies the latest intervention time for risky manipulations, enabling rigorous evaluation of whether a failure prediction is actionable. We validate our approach on both simulation and real-world datasets. Our experimental results demonstrate that PREFAIL substantially improves both the accuracy and timeliness of responses to failure precursors.

URL PDF HTML 收藏
2607.16742 2026-07-21 cs.CV 新提交

Multi-Dimensional Quality Assessment for AI-Generated Human-Centric Videos: Dataset and Model

人工智能生成的以人为中心的视频的多维质量评估:数据集与模型

Sijing Wu, Yunhao Li, Huiyu Duan, Yucheng Zhu, Xiongkuo Min, Patrick Le Callet, Guangtao Zhai

机构 * Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University(上海交通大学图像通信与网络工程研究所) USC-SJTU Institute of Cultural and Creative Industry, Shanghai Jiao Tong University(上海交通大学南加州大学文化创意产业学院) Polytech Nantes, Université de Nantes(法国南特大学高等理工学院)

AI总结 研究针对AI生成的以人为中心的视频质量评估问题,提出扩展数据集HVEval+并构建MoE-Rater模型,该模型采用专家混合及三阶段训练策略,能统一多种任务,在相关数据集上性能优越,推动了视频质量评估及T2V模型优化。

Comments Accepted for publication in IEEE TCSVT, 2026

详情
AI中文摘要

人工智能生成的以人为中心的视频在众多现代应用中起着关键作用。然而,它们常存在质量问题和语义不匹配,凸显了对此类视频进行有效质量评估的重要性。为此,我们扩展之前的数据集HVEval,加入成对偏好注释,得到HVEval+,这是用于人工智能生成的以人为中心视频的最大整体质量评估数据集。它包含基于综合分类法的1000个提示、由24个文本到视频(T2V)模型生成的20000个视频以及大量人工注释。同时,我们提出MoE-Rater,一种受专家混合(MoE)启发且基于多模态大语言模型(MLLM)的一体化方法,支持在单个模型内进行多维质量评分、多维成对比较和特定类别问答。具体介绍了投影专家混合(MoPE)和LoRA专家混合(MoLE),以及由任务感知预训练、特定任务适应和自适应路由优化组成的三阶段训练策略。大量实验和综合分析表明HVEval+数据集和MoE-Rater方法在推进人工智能生成视频质量评估及促进T2V模型评估与优化方面具有巨大潜力。

英文摘要

AI-generated human-centric videos play a crucial role in a wide range of modern applications. However, they often suffer from quality issues and semantic mismatches, underscoring the importance of effective quality assessment for such videos. To this end, we extend our previous dataset HVEval with pairwise preference annotations, resulting in HVEval+, the largest holistic quality assessment dataset for AI-generated human-centric videos, which comprises 1k prompts based on a comprehensive taxonomy, 20k videos generated by 24 text-to-video (T2V) models, and extensive human annotations, including 60k mean opinion scores (MOSs) and 60k preference pairs across 3 dimensions (i.e., spatial quality, temporal quality, and text-video correspondence), as well as 20k category-specific question-answer (Q&A) pairs. Along with the HVEval+ dataset, we further propose MoE-Rater, a Mixture-of-Experts (MoE)-inspired and multimodal large language model (MLLM)-based all-in-one method that supports multi-dimensional quality rating, multi-dimensional pairwise comparison, and category-specific question answering within a single model. Specifically, we introduce Mixture of Projector Experts (MoPE) and Mixture of LoRA Experts (MoLE), together with a three-stage training strategy consisting of task-aware pre-training, task-specific adaptation, and adaptive routing optimization, to effectively unify multiple tasks, resulting in superior performance on both HVEval+ and Human-AGVQA datasets. Extensive experiments and comprehensive analysis demonstrate the significant potential of the HVEval+ dataset and the MoE-Rater method in advancing AI-generated video quality assessment and further facilitating the evaluation and optimization of T2V models.

URL PDF HTML 收藏
2607.16311 2026-07-21 cs.CV cs.AI 新提交

Seeing What Is Actually There: PriVE-Bench and PriVE-Tools for Counterfactual Evaluation of Agentic Visual Evidence in VLMs

看清实际存在的东西:用于在视觉语言模型中对代理视觉证据进行反事实评估的PriVE-Bench和PriVE-Tools

Jingyu Sun, Jiachen Tu, Yuyang Xue, Yaoxin Jiang, Guoyi Xu, Zhengtao Yao, Rui Qian, Yizheng Sun, Hongpeng Zhou, Jingyuan Sun, Yan Lin

机构 * The University of Manchester(曼彻斯特大学) The University of Melbourne(墨尔本大学) University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) University of Edinburgh(爱丁堡大学) University of Southern California(南加州大学) Fudan University(复旦大学) University of Newcastle(纽卡斯尔大学)

AI总结 本文针对视觉语言模型常依先验而非图像回答问题的现象,引入PriVE-Bench和PriVE-Tools。通过配对图像及工具衍生证据评估模型,对比不同输入,发现视觉证据工具在特定情况有帮助,但不能解决所有模型依先验回答的问题。

详情
AI中文摘要

视觉语言模型(VLMs)常依据学习到的语言和类别先验回答视觉问题,而非基于图像本身。反事实图像为这种失败模式提供了自然诊断场景。现有反事实基准主要询问先验跟随行为是否存在,本文进一步探讨:额外视觉证据视图能否帮助VLMs对抗先验?为此引入PriVE-Bench,用配对的原始图像和反事实图像区分基于视觉的答案和与先验一致的错误。还引入PriVE-Tools评估工具衍生的视觉证据是否改善反事实冲突下的基础。通过对比不同输入,结果显示视觉证据工具在某些情况下有帮助,但并非通用解决方案。

英文摘要

Vision-language models (VLMs) often answer visual questions using learned language and category priors rather than grounding their predictions in the image itself. Counterfactual images provide a natural diagnostic setting for this failure mode: when visible evidence contradicts what is usually true, a grounded model should answer from the pixels, while a prior-following model will produce a canonical but visually incorrect response. However, existing counterfactual benchmarks mainly ask whether such prior-following behavior exists. In this paper, we ask a further question motivated by the rise of tool-augmented and agentic vision systems: can additional visual evidence views help VLMs reason against their priors? We introduce PriVE-Bench, a Prior-vs-Visual Evidence Benchmark that uses paired original and counterfactual images to distinguish visually grounded answers from prior-consistent errors. We further introduce PriVE-Tools, a controlled agentic-vision-inspired extension that evaluates whether tool-derived visual evidence -- including bounding boxes, crops, zoom panels, and contours -- improves grounding under the same counterfactual conflicts. Across open- and closed-source VLMs, we compare raw, paired-image, and tool-conditioned inputs using accuracy, prior-following error rate, and other-response rate. Our results show that visual evidence tools can help in some settings, especially when models can use localized evidence effectively, but they are not a universal remedy: several models continue to follow language and category priors even when relevant visual evidence is explicitly provided.

URL PDF HTML 收藏
2603.18046 2026-07-21 cs.LG cs.AI cs.CR 版本更新

NanoZK: Privacy-Preserving Verifiable Inference for Large Language Models via Layerwise Zero-Knowledge Proofs

NANOZK:用于可验证大语言模型推理的分层零知识证明

Zhaohui Wang

机构 * USC Viterbi School of Engineering(USC维特里维学院工程学院)

AI总结 NANOZK通过分层零知识证明验证大语言模型推理,采用分层证明框架实现常数大小证明,提升可扩展性与并行证明效率,同时保持形式正确性。

Comments Extended version. The first 12 pages correspond to the ICICS 2026 (Springer LNCS) camera-ready paper. This version supersedes the earlier ICLR 2026 VeriFAI Workshop preprint and adds full security proofs, Halo2 circuit details, lookup-table derivations, extended experiments, verifier-cost analysis, GPU scaling, reproducibility instructions, and appendices omitted from the proceedings

详情
AI中文摘要

当用户查询专有LLM API时,他们收到的输出缺乏加密保证,无法确认所用模型的真实性。服务提供商可能使用更便宜的模型、应用激进的量化或返回缓存响应,这些行为对付费用户无法检测。我们提出了METHOD,一种零知识证明系统,使LLM推理可验证:用户可以通过加密方式确认输出对应特定模型的计算。我们的方法利用transformer推理自然分解为独立层计算的事实,从而实现分层证明框架,每层生成大小与模型宽度无关的证明。这种分解规避了单体方法面临的可扩展性障碍,并允许并行证明。我们开发了查找表近似方法用于非算术运算(softmax,GELU,LayerNorm),这些方法引入零测量精度损失。我们还引入Fisher信息引导的验证方法,用于在证明所有层不现实的情况下。在transformer模型d=128上,METHOD生成大小为5.5KB(2.1KB注意力+3.5KB MLP)的常数大小分层证明,验证时间24毫秒。与EZKL相比,METHOD在d=128时证明大小小70倍,证明时间快5.7倍,同时保持形式正确性保证(epsilon < 1e-37)。查找表近似方法精确保持模型困惑度,使验证无需质量妥协。

英文摘要

We present NanoZK, a zero-knowledge proof system for verifiable LLM inference: clients and third-party auditors check that a provider executed the advertised model on a committed input without learning weights or activations. NanoZK introduces a layerwise proof framework that decomposes transformer inference into independently provable layers linked by a SHA-256 commitment chain, yielding constant-size sub-circuit proofs (3.5-3.7 KB; about 83 KB total at L=12), comparable in total size to and substantially more parallelizable than prior ZKML's monolithic 101-126 KB proofs. We prove compositional soundness and zero-knowledge under standard assumptions, design 16-bit lookup-table approximations for softmax, GELU, and normalization with measured perplexity degradation below 1e-4 across six model/dataset combinations, and add a Fisher-information-guided audit-budget triage as an efficiency tool (full soundness still requires verifying every layer). On CPU the MLP sub-circuit proves in about 6.3 s prove-only (about 43 s setup plus prove) with about 22 ms verification at any width; attention prove-only time scales from 0.9 s (d=16) to 184 s (d=256); full-block end-to-end proofs are measured to d=128, with a projected GPU time of about 68 s per block at d=768 from measured O(d^2) MSM scaling and a conservative 15-30x GPU-MSM speedup range based on Icicle's published 30x result for n >= 2^20 and extrapolated to the smaller-n regime. Privacy scope: NanoZK hides weights and activations from verifiers and auditors but does not hide the prompt from the prover; this is complementary to HE/MPC.

URL PDF HTML 收藏
2603.07530 2026-07-21 cs.RO 版本更新

ICLR: In-Context Imitation Learning with Visual Reasoning

ICLR: 基于视觉推理的上下文模仿学习

Toan Nguyen, Weiduo Yuan, Songlin Wei, Hui Li, Daniel Seita, Yue Wang

机构 * University of Southern California(南加州大学) Autodesk Research(Autodesk研究)

AI总结 ICLR通过结合视觉推理与上下文模仿学习,提升机器人在复杂任务中的适应性和泛化能力。

Comments Accepted to IROS 2026. Project website: https://toannguyen1904.github.io/ICLR

详情
AI中文摘要

上下文模仿学习使机器人能够从少量示范中适应新任务,而无需额外训练。然而,现有方法通常仅基于状态-动作轨迹进行条件判断,缺乏对任务意图的显式表示。这种局限性阻碍了在复杂和模糊的任务设置中的性能,因为在这些情况下,相同的行为可能符合不同的目标。为了解决这一问题,我们提出了基于视觉推理的上下文模仿学习(ICLR),一种新的框架,该框架在示范提示中加入了结构化的视觉推理轨迹,表示在图像空间中预期的机器人轨迹。ICLR还联合学习生成推理轨迹和低层动作,这在统一的自回归变压器中实现,使模型能够模仿不仅动作预测,还有导致这些动作的推理过程。我们广泛地在模拟和现实世界操作任务中评估ICLR,并展示了与其它上下文模仿学习方法相比,在成功率和泛化到未见任务和新物体配置方面的持续改进。这些结果表明,结合具身视觉推理代表了增强机器人上下文学习系统鲁棒性和泛化能力的有希望的方向。

英文摘要

In-context imitation learning enables robots to adapt to new tasks from a small number of demonstrations without additional training. However, existing approaches typically condition only on state-action trajectories and lack explicit representations of task intent. This limitation hinders performance in complex and ambiguous task settings where the same actions may be consistent with different objectives. To address this, we present In-Context Imitation Learning with Visual Reasoning (ICLR), a novel framework that augments demonstration prompts with structured visual reasoning traces representing anticipated future robot trajectories in image space. ICLR also jointly learns to generate reasoning traces and low-level actions within a unified autoregressive transformer, enabling the model to mimic not only action prediction but also the reasoning process that leads to those actions. We extensively evaluate ICLR in both simulation and real-world manipulation tasks and demonstrate consistent improvements in success rates and generalization to unseen tasks and novel object configurations compared to other in-context imitation learning methods. These results suggest that incorporating embodied visual reasoning represents a promising direction for enhancing the robustness and generalization of robotic in-context learning systems.

URL PDF HTML 收藏
2506.06570 2026-07-21 cs.RO 版本更新

Unsupervised Discovery of Failure Taxonomies from Deployment Logs

无监督发现部署日志中的故障分类

Aryaman Gupta, Yusuf Umut Ciftci, Somil Bansal

机构 * Stanford University(斯坦福大学) University of Southern California(南加州大学)

AI总结 本文提出无监督发现部署日志中的故障分类方法,通过视觉-语言推理和语义聚类,提升机器人系统鲁棒性和故障监控能力。

详情
AI中文摘要

随着机器人系统越来越深入地融入现实世界环境,从自动驾驶汽车到家庭助手,它们不可避免地会遇到多样且无结构的场景,导致故障。虽然这些故障带来了安全性和可靠性挑战,但它们也提供了丰富的感知数据以提高系统鲁棒性。然而,手动分析大规模故障数据集是不切实际的,也无法扩展。在本文中,我们提出了从大量原始故障日志中无监督发现故障分类的问题,旨在直接从感知轨迹中获得语义连贯且可操作的故障模式。我们的方法首先通过视觉-语言推理从多模态输入中推断出结构化的故障解释,然后在由此产生的语义推理空间中进行聚类,从而发现重复的故障模式,而不是孤立的事件级描述。我们评估了我们的方法在机器人操作、室内导航和自动驾驶领域,并证明所发现的分类是连贯的、可解释的且在实践中是有用的。特别是,我们展示了结构化的故障分类指导了针对离线策略优化的数据收集,并增强了运行时故障监控系统。

英文摘要

As robotic systems become increasingly integrated into real-world environments, ranging from autonomous vehicles to household assistants, they inevitably encounter diverse and unstructured scenarios that lead to failures. While such failures pose safety and reliability challenges, they also provide rich perceptual data for improving system robustness. However, manually analyzing large-scale failure datasets is impractical and does not scale. In this work, we introduce the problem of unsupervised discovery of failure taxonomies from large volumes of raw failure logs, aiming to obtain semantically coherent and actionable failure modes directly from perceptual trajectories. Our approach first infers structured failure explanations from multimodal inputs using vision language reasoning, then clusters them in the resulting semantic reasoning space, discovering recurring failure modes rather than isolated episode-level descriptions. We evaluate our method across robotic manipulation, indoor navigation, and autonomous driving domains, demonstrating that the discovered taxonomies are consistent, interpretable, and useful in practice. In particular, we show that structured failure taxonomies guide targeted data collection for offline policy refinement and enhance runtime failure monitoring systems. Website: https://mllm-failure-clustering.github.io/

URL PDF HTML 收藏
2602.22446 2026-07-21 cs.LG cs.AI

ECHO: Encoding Communities via High-order Operators

ECHO:通过高阶运算编码社区

Emilio Ferrara

机构 * Thomas Lord Department of Computer Science, University of Southern California(美国南加州大学汤姆·劳德计算机科学系)

AI总结 ECHO通过高阶运算和自监督架构,解决社区检测中的拓扑与语义瓶颈,实现高效准确的社区划分。

Journal ref Machine Learning with Applications, Volume 25, 100930, 2026

详情
AI中文摘要

在具有属性的网络中进行社区检测面临一个根本性的分歧:拓扑算法忽视语义特征,而图神经网络(GNNs)则遭遇毁灭性的计算瓶颈。具体而言,GNNs在密集或异质网络中受到语义墙的制约,特征平滑过度,而在配对聚类中受到系统墙的驱动,O(N^2)内存约束。为了打破这些障碍,我们引入ECHO(通过高阶运算编码社区),一种可扩展的自监督架构,将社区检测重新定义为一种自适应的多尺度扩散过程。ECHO具有拓扑感知路由器,能够自动分析结构启发式稀疏性、密度和 assortativity,将图路由到最优的归纳偏差,防止异质性污染,同时确保语义密集化。结合一种内存分片的全批量对比目标和一种新的分块O(N·K)相似性提取方法,ECHO完全绕过了传统O(N^2)内存瓶颈,而不牺牲全局梯度的数学精度。广泛的评估表明,这种拓扑特征协同一致地克服了经典分辨率限制。在扩展到100万个节点的合成LFR基准测试中,ECHO在严重拓扑噪声下仍保持尺度不变的准确性。此外,在拥有超过160万个节点和3000万条边的大型真实世界社交网络中,它在几分钟内完成聚类,吞吐量超过2800个节点每秒,与高度优化的纯拓扑基线速度相当。实现采用了一个统一的框架,自动启用内存分片优化,以支持在不同硬件约束下的应用。GitHub仓库:https://github.com/emilioferrara/ECHO-GNN

英文摘要

Community detection in attributed networks faces a fundamental divide: topological algorithms ignore semantic features, while Graph Neural Networks (GNNs) encounter devastating computational bottlenecks. Specifically, GNNs suffer from a Semantic Wall of feature over smoothing in dense or heterophilic networks, and a Systems Wall driven by the O(N^2) memory constraints of pairwise clustering. To dismantle these barriers, we introduce ECHO (Encoding Communities via High order Operators), a scalable, self supervised architecture that reframes community detection as an adaptive, multi scale diffusion process. ECHO features a Topology Aware Router that automatically analyzes structural heuristics sparsity, density, and assortativity to route graphs through the optimal inductive bias, preventing heterophilic poisoning while ensuring semantic densification. Coupled with a memory sharded full batch contrastive objective and a novel chunked O(N \cdot K) similarity extraction method, ECHO completely bypasses traditional O(N^2) memory bottlenecks without sacrificing the mathematical precision of global gradients. Extensive evaluations demonstrate that this topology feature synergy consistently overcomes the classical resolution limit. On synthetic LFR benchmarks scaled up to 1 million nodes, ECHO achieves scale invariant accuracy despite severe topological noise. Furthermore, on massive real world social networks with over 1.6 million nodes and 30 million edges, it completes clustering in mere minutes with throughputs exceeding 2,800 nodes per second matching the speed of highly optimized purely topological baselines. The implementation utilizes a unified framework that automatically engages memory sharded optimization to support adoption across varying hardware constraints. GitHub Repository: https://github.com/emilioferrara/ECHO-GNN

URL PDF HTML 收藏
2601.03481 2026-07-21 cs.CL 版本更新

Self-Explaining Hate Speech Detection with Moral Rationales

基于道德依据的自解释仇恨言论检测

Francielle Vargas, Jackson Trager, Diego Alves, Surendrabikram Thapa, Matteo Guida, Berk Atil, Daryna Dementieva, Andrew Smart, Ameeta Agrawal

机构 * University of São Paulo(圣保罗大学) University of Southern California(南加州大学) Saarland University(萨尔兰大学) Virginia Tech(弗吉尼亚理工大学) University of Melbourne(墨尔本大学) Pennsylvania State University(宾夕法尼亚州立大学) Technical University of Munich(慕尼黑技术大学) Google Research(谷歌研究) Portland State University(波特兰州立大学)

AI总结 研究针对现有仇恨言论检测模型的不足,提出SMRA框架,将道德依据监督融入训练目标,引入新数据集。该框架在检测任务中提升性能,增强解释,且公平性稳定。

Comments This paper was published at Findings of the Association for Computational Linguistics: ACL 2026 (https://aclanthology.org/2026.findings-acl.1704/)

详情
AI中文摘要

现有仇恨言论检测模型往往不透明且依赖表面词汇线索,易受虚假关联影响,限制了鲁棒性、可解释性和文化情境化。本文提出监督道德依据注意力(SMRA)框架,将道德依据作为注意力对齐的直接监督,基于道德基础理论使词元级注意力与专家标注的道德依据对齐。不同于先前方法,SMRA将道德依据监督直接融入训练目标,生成可解释且情境化的解释。还引入巴西葡萄牙语基准数据集HateBRMoralXplain。实验表明,SMRA在仇恨言论检测和多标签道德情感分类中提升了性能,增强了解释,公平性稳定。

英文摘要

Existing hate speech detection models are often opaque and rely on surface-level lexical cues, which makes them vulnerable to spurious correlations and limits robustness, interpretability and cultural contextualization. We propose Supervised Moral Rationale Attention (SMRA), the first self-explaining hate speech detection framework to incorporate moral rationales as direct supervision for attention alignment. Based on Moral Foundations Theory, SMRA aligns token-level attention with expert-annotated moral rationales, guiding models to attend to morally salient spans. Unlike prior rationale-supervised or post-hoc approaches, SMRA integrates moral rationale supervision directly into the training objective, producing inherently interpretable and contextualized explanations. To support our framework, we also introduce HateBRMoralXplain, a Brazilian Portuguese benchmark dataset annotated with hate labels, moral categories, token-level moral rationales, and socio-political metadata. Across binary hate speech detection and multi-label moral sentiment classification, SMRA consistently improves performance while enhancing both faithful and plausible explanations. Although explanations become more concise, sufficiency decreases, indicating more compact and informative rationales. Fairness remains stable, suggesting that improvements in explanation quality do not introduce significant bias trade-offs.

URL PDF HTML 收藏
2601.00306 2026-07-21 cs.CY cs.AI cs.HC

The Generative AI Paradox: GenAI and the Erosion of Trust, the Corrosion of Information Verification, and the Demise of Truth

生成AI悖论:生成AI与信任的侵蚀、信息验证的腐蚀以及真理的消亡

Emilio Ferrara

机构 * Thomas Lord Department of Computer Science, University of Southern California (USC)(汤姆斯·劳德计算机科学系,南加州大学) Information Sciences Institute (ISI), University of Southern California (USC)(信息科学研究所,南加州大学)

AI总结 本文探讨生成AI带来的信任危机,提出合成现实的分层结构,并强调其对社会认知基础的侵蚀,呼吁建立互补的缓解措施以应对AI带来的挑战。

Journal ref Future Internet, 18(2), 73, 2026

详情
AI中文摘要

生成AI(GenAI)现在能够生成文本、图像、音频和视频,这些内容在大规模生产中可以被感知为真实,并且边际成本极低。尽管公众辩论往往将相关危害描述为“深度伪造”或对 misinformation 和欺诈的逐步扩展,但这种观点忽略了更广泛的社会技术转变:生成AI使合成现实成为可能;即相干、互动且可能个性化的信息环境,在其中内容、身份和社会互动是共同制造并相互强化的。我们主张,最严重的风险不在于孤立合成制品的生产,而在于合成内容、合成身份和合成互动变得容易生成却难以审核,从而逐步侵蚀共享的认知基础和机构验证实践。本文(i)将合成现实形式化为分层堆栈(内容、身份、互动、机构);(ii)扩展了涵盖个人、经济、信息和社会技术风险的生成AI危害分类学;(iii)阐述了生成AI引入的定性变化(成本崩溃、吞吐量、定制、微分段、来源缺口和信任侵蚀);(iv)将最近的风险现实(2023-2025)综合成一个紧凑的案例库,说明这些机制如何在欺诈、选举、骚扰、文档和供应链妥协中体现。我们随后提出一个缓解堆栈,将来源基础设施、平台治理、机构工作流程重新设计和公众韧性视为互补而非可替代的要素,并概述一个专注于测量认知安全性的研究议程。我们最后得出结论:随着合成媒体变得普遍,社会可能会理性地完全忽视数字证据。

英文摘要

Generative AI (GenAI) now produces text, images, audio, and video that can be perceptually convincing at scale and at negligible marginal cost. While public debate often frames the associated harms as "deepfakes" or incremental extensions of misinformation and fraud, this view misses a broader socio-technical shift: GenAI enables synthetic realities; coherent, interactive, and potentially personalized information environments in which content, identity, and social interaction are jointly manufactured and mutually reinforcing. We argue that the most consequential risk is not merely the production of isolated synthetic artifacts, but the progressive erosion of shared epistemic ground and institutional verification practices as synthetic content, synthetic identity, and synthetic interaction become easy to generate and hard to audit. This paper (i) formalizes synthetic reality as a layered stack (content, identity, interaction, institutions), (ii) expands a taxonomy of GenAI harms spanning personal, economic, informational, and socio-technical risks, (iii) articulates the qualitative shifts introduced by GenAI (cost collapse, throughput, customization, micro-segmentation, provenance gaps, and trust erosion), and (iv) synthesizes recent risk realizations (2023-2025) into a compact case bank illustrating how these mechanisms manifest in fraud, elections, harassment, documentation, and supply-chain compromise. We then propose a mitigation stack that treats provenance infrastructure, platform governance, institutional workflow redesign, and public resilience as complementary rather than substitutable, and outline a research agenda focused on measuring epistemic security. We conclude with the Generative AI Paradox: as synthetic media becomes ubiquitous, societies may rationally discount digital evidence altogether.

URL PDF HTML 收藏
2511.18635 2026-07-21 cs.CL cs.AI cs.CY

No Free Lunch in Language Model Bias Mitigation? Targeted Bias Reduction Can Exacerbate Unmitigated LLM Biases

语言模型偏见缓解中的“无免费午餐”现象?针对性偏见减少可能加剧未缓解的LLM偏见

Shireen Chand, Faith Baca, Emilio Ferrara

机构 * University of Southern California(南加州大学)

AI总结 本文研究了语言模型偏见缓解的跨类别影响,发现针对性缓解可能加剧其他方面的偏见,强调了多维评估的重要性。

Journal ref AI, 7(1), 24, 2026

详情
AI中文摘要

大型语言模型(LLMs)从训练数据中继承了社会偏见,可能产生有害或不公平的输出。尽管各种技术旨在减轻这些偏见,但其效果通常仅在被针对的偏见维度上进行评估。本文研究了针对性偏见缓解的跨类别后果。我们研究了四种偏见缓解技术在七个模型家族的十个模型上的应用,并探讨了种族、宗教、职业和性别相关的偏见。我们使用StereoSet基准测试测量去偏见对模型连贯性和刻板印象偏好的影响。我们的结果一致显示,尽管针对性缓解有时可以减少预期维度的偏见,但它经常导致其他方面的意外和通常负面后果,例如增加模型偏见和降低整体连贯性。这些发现强调了在研究和开发偏见缓解策略时,需要强大的、多维的评估工具,以避免无意中在未针对的轴上转移或加剧偏见。

英文摘要

Large Language Models (LLMs) inherit societal biases from their training data, potentially leading to harmful or unfair outputs. While various techniques aim to mitigate these biases, their effects are often evaluated only along the dimension of the bias being targeted. This work investigates the cross-category consequences of targeted bias mitigation. We study four bias mitigation techniques applied across ten models from seven model families, and we explore racial, religious, profession- and gender-related biases. We measure the impact of debiasing on model coherence and stereotypical preference using the StereoSet benchmark. Our results consistently show that while targeted mitigation can sometimes reduce bias in the intended dimension, it frequently leads to unintended and often negative consequences in others, such as increasing model bias and decreasing general coherence. These findings underscore the critical need for robust, multi-dimensional evaluation tools when examining and developing bias mitigation strategies to avoid inadvertently shifting or worsening bias along untargeted axes.

URL PDF HTML 收藏
2506.12349 2026-07-21 cs.CY cs.AI cs.CL

Information Suppression in Large Language Models: Auditing, Quantifying, and Characterizing Censorship in DeepSeek

大语言模型中的信息压制:对DeepSeek的信息审查、量化与特征化

Peiran Qiu, Siyi Zhou, Emilio Ferrara

机构 * Thomas Lord Department of Computer Science, University of Southern California, USA(汤姆斯·劳德计算机科学系,南加州大学) Information Sciences Institute, University of Southern California, USA(信息科学研究所,南加州大学) Annenberg School of Communication, University of Southern California, USA(安纳伯格传播学院,南加州大学)

AI总结 本研究通过审计框架揭示DeepSeek在处理政治敏感提示时的信息压制现象,指出模型在内部推理中保留敏感内容,但在最终输出中进行过滤或改写,强调了对AI模型中信息压制机制进行系统审查的重要性。

Journal ref Inf. Sci. 724, C (Jan 2026)

详情
AI中文摘要

本研究探讨了DeepSeek中信息压制机制,DeepSeek是一款在中国开发的开源大语言模型(LLM)。我们提出了一种审计框架,并利用该框架分析模型对646个政治敏感提示的响应,通过将模型的最终输出与中间的推理链(CoT)进行比较。我们的审计揭示了DeepSeek在语义层面的信息压制证据:敏感内容常出现在模型内部推理中,但在最终输出中被省略或改写。具体而言,DeepSeek压制了对透明度、政府问责和公民动员的参考,同时偶尔放大与国家宣传一致的语言。本研究强调了对广泛采用的AI模型中对齐、内容审查、信息压制和审查实践进行系统审计的必要性,以确保透明度、问责制和通过这些系统获取的无偏信息的公平访问。

英文摘要

This study examines information suppression mechanisms in DeepSeek, an open-source large language model (LLM) developed in China. We propose an auditing framework and use it to analyze the model's responses to 646 politically sensitive prompts by comparing its final output with intermediate chain-of-thought (CoT) reasoning. Our audit unveils evidence of semantic-level information suppression in DeepSeek: sensitive content often appears within the model's internal reasoning but is omitted or rephrased in the final output. Specifically, DeepSeek suppresses references to transparency, government accountability, and civic mobilization, while occasionally amplifying language aligned with state propaganda. This study underscores the need for systematic auditing of alignment, content moderation, information suppression, and censorship practices implemented into widely-adopted AI models, to ensure transparency, accountability, and equitable access to unbiased information obtained by means of these systems.

URL PDF HTML 收藏
2505.20161 2026-07-21 cs.LG cs.AI cs.CL 版本更新

Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoning

棱柱形合成:基于梯度的数据多样化提升语言模型推理中的泛化能力

Jaehun Jung, Seungju Han, Ximing Lu, Skyler Hallinan, David Acuna, Shrimai Prabhumoye, Mostafa Patwary, Mohammad Shoeybi, Bryan Catanzaro, Yejin Choi

机构 * NVIDIA Research(NVIDIA研究部) University of Washington(华盛顿大学) University of Southern California(南加州大学)

AI总结 研究语言模型训练数据多样性对泛化的作用,提出基于梯度熵的G - Vendi指标,进而构建棱柱形合成框架生成多样合成数据,有效提升模型性能,在多个基准测试中表现优于依赖更大数据生成器的模型。

详情
AI中文摘要

语言模型中的有效泛化关键取决于训练数据的多样性。现有多样性指标常依赖与模型行为脱节的表面启发式方法,难以达成目标。为此研究何种训练数据多样性驱动语言模型泛化及如何衡量与增强它。通过超300次训练运行的大规模实证分析表明,数据多样性可有力预测语言模型推理中的泛化。引入G - Vendi指标,基于模型诱导梯度的熵量化多样性,表现优于其他方法。在此基础上提出棱柱形合成框架,通过针对梯度空间中代表性不足区域生成多样合成数据。实验结果显示,随着合成数据规模增加,棱柱形合成持续提升模型性能,在多个基准测试中显著优于依赖更大数据生成器的现有模型。

英文摘要

Effective generalization in language models depends critically on the diversity of their training data. Yet existing diversity metrics often fall short of this goal, relying on surface-level heuristics that are decoupled from model behavior. This motivates us to ask: What kind of diversity in training data actually drives generalization in language models -- and how can we measure and amplify it? Through large-scale empirical analyses spanning over 300 training runs, carefully controlled for data scale and quality, we show that data diversity can be a strong predictor of generalization in LLM reasoning -- as measured by average model performance on unseen out-of-distribution benchmarks. We introduce G-Vendi, a metric that quantifies diversity via the entropy of model-induced gradients. Despite using a small off-the-shelf proxy model for gradients, G-Vendi consistently outperforms alternative measures, achieving strong correlation (Spearman's $ρ\approx 0.9$) with out-of-distribution (OOD) performance on both natural language inference (NLI) and math reasoning tasks. Building on this insight, we present Prismatic Synthesis, a framework for generating diverse synthetic data by targeting underrepresented regions in gradient space. Experimental results show that Prismatic Synthesis consistently improves model performance as we scale synthetic data -- not just on in-distribution test but across unseen, out-of-distribution benchmarks -- significantly outperforming state-of-the-art models that rely on 20 times larger data generator than ours. For example, PrismMath-7B, our model distilled from a 32B LLM, outperforms R1-Distill-Qwen-7B -- the same base model trained on proprietary data generated by 671B R1 -- on 6 out of 7 challenging benchmarks.

URL PDF HTML 收藏
2501.11849 2026-07-21 cs.CL cs.AI cs.SI

Network-informed Prompt Engineering against Organized Astroturf Campaigns under Extreme Class Imbalance

在极端类别不平衡下基于网络的提示工程对抗有组织的Astroturf活动

Nikos Kanakaris, Heng Ping, Xiongye Xiao, Nesreen K. Ahmed, Luca Luceri, Emilio Ferrara, Paul Bogdan

机构 * University of Southern California(美国南加州大学) Cisco AI Research(思科人工智能研究)

AI总结 本文提出基于大型语言模型的Balanced RAG框架,通过提示工程和平衡检索增强生成技术,在极端类别不平衡下有效识别协调虚假信息活动。

Journal ref WWW '25: Companion Proceedings of the ACM on Web Conference 2025

详情
AI中文摘要

检测有组织的政治活动在对抗社交媒体上的虚假信息方面至关重要。现有的识别此类有组织活动的方法主要采用网络科学、图机器学习和自然语言处理技术。其最终目标是分析用户之间的关系和互动(例如转发)以及他们帖子之间的文本相似性。尽管这些方法在识别Astroturf活动方面有效,但它们面临显著的挑战,即可用训练数据集中的类别不平衡问题。为缓解这一问题,最近的方法通常依赖于数据增强或增加正样本数量,这在现实世界中可能并不总是可行或充分。沿着不同的路径,本文提出了一种基于大型语言模型(LLMs)的新型框架,引入了平衡检索增强生成(Balanced RAG)组件。我们的方法首先将帖子的文本信息(在本例中是推文)和社交网络中的用户互动作为输入提供给语言模型。然后,通过提示工程和所提出的平衡RAG方法,它有效检测了X(Twitter)上的协调虚假信息活动。所提出的框架不需要对语言模型进行任何训练或微调。相反,通过战略性地利用提示工程和平衡RAG的优势,它使LLMs能够克服类别不平衡的影响,并有效识别协调的政治活动。实验结果表明,通过结合所提出的提示工程和平衡RAG方法,我们的框架在精度、召回率和F1分数方面优于传统的基于图的基线方法,实现了2至3倍的提升。

英文摘要

Detecting organized political campaigns is of paramount importance in fighting against disinformation on social media. Existing approaches for the identification of such organized actions employ techniques mostly from network science, graph machine learning and natural language processing. Their ultimate goal is to analyze the relationships and interactions (e.g. re-posting) among users and the textual similarities of their posts. Despite their effectiveness in recognizing astroturf campaigns, these methods face significant challenges, notably the class imbalance in available training datasets. To mitigate this issue, recent methods usually resort to data augmentation or increasing the number of positive samples, which may not always be feasible or sufficient in real-world settings. Following a different path, in this paper, we propose a novel framework for identifying astroturf campaigns based solely on large language models (LLMs), introducing a Balanced Retrieval-Augmented Generation (Balanced RAG) component. Our approach first gives both textual information concerning the posts (in our case tweets) and the user interactions of the social network as input to a language model. Then, through prompt engineering and the proposed Balanced RAG method, it effectively detects coordinated disinformation campaigns on X (Twitter). The proposed framework does not require any training or fine-tuning of the language model. Instead, by strategically harnessing the strengths of prompt engineering and Balanced RAG, it facilitates LLMs to overcome the effects of class imbalance and effectively identify coordinated political campaigns. The experimental results demonstrate that by incorporating the proposed prompt engineering and Balanced RAG methods, our framework outperforms the traditional graph-based baselines, achieving 2x-3x improvements in terms of precision, recall and F1 scores.

URL PDF HTML 收藏
2311.10781 2026-07-21 cs.CL cs.AI

Can Language Model Moderators Improve the Health of Online Discourse?

语言模型调解者能否改善在线讨论的健康状况?

Hyundong Cho, Shuai Liu, Taiwei Shi, Darpan Jain, Basem Rizk, Yuyang Huang, Zixun Lu, Nuan Wen, Jonathan Gratch, Emilio Ferrara, Jonathan May

机构 * Department of Computer Science and Information Sciences Institute University of Southern California(计算机科学系和信息科学研究所 南加州大学)

AI总结 本文探讨了语言模型作为对话调解员的效果,发现其能提供具体公平的反馈,但难以提升用户尊重与合作水平。

Comments 9 pages, NAACL 2024 Main

Journal ref Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies

详情
AI中文摘要

在线社区的对话调解对于维持文明的建设性环境至关重要,但扩展这种调解却具有挑战性,且对调解员有害。将复杂的自然语言生成模块作为增强手段来辅助人类调解员是一个诱人的前景,但迄今为止尚缺乏充分的评估方法。在本文中,我们基于调解文献建立了对话调解有效性的系统定义,并建立了进行真实但安全评估的设计标准。我们随后提出了一种综合的评估框架,以独立于人类干预的方式评估模型的调解能力。借助我们的框架,我们进行了首次已知的研究,探讨语言模型作为对话调解员的作用,发现适当提示的模型,如果结合了社会科学的见解,能够为有毒行为提供具体且公平的反馈,但难以影响用户提高尊重和合作的水平。

英文摘要

Conversational moderation of online communities is crucial to maintaining civility for a constructive environment, but it is challenging to scale and harmful to moderators. The inclusion of sophisticated natural language generation modules as a force multiplier to aid human moderators is a tantalizing prospect, but adequate evaluation approaches have so far been elusive. In this paper, we establish a systematic definition of conversational moderation effectiveness grounded on moderation literature and establish design criteria for conducting realistic yet safe evaluation. We then propose a comprehensive evaluation framework to assess models' moderation capabilities independently of human intervention. With our framework, we conduct the first known study of language models as conversational moderators, finding that appropriately prompted models that incorporate insights from social science can provide specific and fair feedback on toxic behavior but struggle to influence users to increase their levels of respect and cooperation.

URL PDF HTML 收藏
2607.16165 2026-07-20 cs.CV cs.AI cs.CL cs.LG 新提交

An Exam for Active Observers

主动观察者的测试

Jiarui Zhang, Muzi Tao, Shangshang Wang, Ollie Liu, Xuezhe Ma, Willie Neiswanger

机构 * University of Southern California(南加州大学)

AI总结 研究多模态大语言模型是否具备主动观察能力,引入ActiveVision基准测试,发现前沿模型表现不佳,即便能编写视觉代码差距仍存,表明当前模型缺乏主动视觉观察,呼吁构建闭合感知 - 推理循环的架构和训练目标。

Comments 17 pages, 8 figures, 4 tables. Project page: https://activevision.dev

详情
AI中文摘要

人类视觉是一个闭环:注视会不断被中间假设重新引导,而非单一快照。数十年来,心理物理学和认知科学认为这种主动观察对广泛任务至关重要。当前视觉语言基准无法回答当今的多模态大语言模型(MLLM)是否进行主动观察。我们引入了ActiveVision基准,它能让MLLM的主动观察可测量,包含3类17个任务,旨在促使重复视觉感知。前沿MLLM在ActiveVision上表现不佳,最高得分模型GPT - 5.5在最高推理努力层级仅解决10.6%的项目,17个任务中有11个得零分,Claude Fable 5也仅解决3.5%,远落后于平均96.1%的三名人类参与者。即便模型编写并运行自己的视觉代码,差距依然存在,因为代码在现实图像中不可靠,而捕捉其失败需要模型所缺乏的主动感知。这些结果表明当前MLLM缺乏强大的主动视觉观察能力,这促使构建能闭合感知 - 推理循环的架构和训练目标。

英文摘要

Human vision is a closed loop: gaze is continuously redirected by intermediate hypotheses rather than a single snapshot. Decades of psychophysics and cognitive science have argued that this active observation is essential for a wide range of tasks. Whether today's multimodal large language models (MLLMs) exercise active observation is an empirical question that current vision-language benchmarks do not answer. We introduce ActiveVision, a benchmark that makes active observation measurable for MLLMs, comprising 17 tasks across 3 categories. Tasks are designed to force repeated visual perception rather than a single static description. Frontier MLLMs collapse on ActiveVision: the highest-scoring model we evaluate, GPT-5.5 at the highest exposed reasoning-effort tier, solves only 10.6% of items and scores zero on 11 of the 17 tasks, and even Claude Fable 5, despite topping most reasoning and coding leaderboards, solves just 3.5%, far behind three human participants who average 96.1%. Furthermore, much of the gap persists even when models write and run their own vision code: such code is unreliable on realistic imagery, and catching its failures itself requires the active perception the models lack. Together, these results indicate that current MLLMs lack robust active visual observation, motivating architectures and training objectives that close the perception-reasoning loop.

URL PDF HTML 收藏
2607.15992 2026-07-20 cs.AI 新提交

Closing the AI Trust Gap: The Case for Independent Certification for Trustworthy AI

缩小人工智能信任差距:可信人工智能独立认证的案例

Trisevgeni Papakonstantinou, Cansu Canca, Farah Nanji, Waheedullah Pardess, Jen Weedon, Jasmijn Remmers, Eliza Krigman, Matthew Ball, Yalda Daryani, Kiran Iqbal, Francielle Vargas, María Llorente Sánchez, Joe Humphreys, Fendi Tsim, Kelly Fitzpatrick, Jeff Dunn, Catherine Feldman

机构 * University College London(伦敦大学学院) AI Ethics Lab(人工智能伦理实验室) University of Cambridge(剑桥大学) Columbia University(哥伦比亚大学) MATS Tech with Intention(技术与意图) University of Southern California(南加州大学) Kyushu University(九州大学) University of Chile(智利大学) BehSci Meets AI(行为科学与人工智能) Digital Trust Council(数字信任委员会)

AI总结 研究指出负责任AI虽有实践但未形成奖励可信度的市场,存在信任差距。原因包括关注重点偏差及三个复合失败。通过审查治理工具发现不足,进而提出以结果为导向的独立认证来缩小信任差距,补充监管与内部治理。

详情
AI中文摘要

在过去十年中,负责任的人工智能(RAI)已产生大量实践,用于识别和减轻人工智能在高风险环境中带来的风险。然而,这项工作尚未产生一个奖励可信度的市场。认真投资于安全、公平和监督的公司无法向消费者、监管机构和股东持续证明其系统超越了最低合规标准。社会缺少一种认可或比较差异的方式,导致了信任差距。我们认为,这种差距部分是由于关注负责任的人工智能(内部流程问题)而非可信的人工智能(可独立验证的现实世界结果问题),并且由于三个复合失败而持续存在:(1)市场无法区分可信系统与其模仿品;(2)评估针对模型和输出而非部署的社会技术系统及其结果;(3)测量生态系统旨在避免伤害而非证明益处。通过审查现有人工智能治理工具并将其与医疗保健、可持续性和安全领域的认证制度进行比较,我们表明没有一个在单一框架中整合治理基线、独立验证的积极结果证据和市场信号。我们提出以结果为导向的独立认证作为可以缩小信任差距的连接层,通过使可信度可衡量、可比较和获得商业回报来补充监管和内部治理。

英文摘要

Over the past decade, responsible AI (RAI) has produced a substantial body of practice for identifying and mitigating the risks AI poses in high-stakes settings. Yet this work has not produced a market that rewards trustworthiness. Firms that invest seriously in safety, fairness, and oversight cannot consistently prove to consumers, regulators, and shareholders that their systems go beyond the bare minimum of compliance. What is missing is a way for society to recognize or compare the difference. The result is a trust gap: a structural condition in which responsible development efforts happen inside organizations but produce no external, independently recognized and verifiable signal of trustworthy outcomes. We argue this gap is sustained in part because of a focus on responsible AI (a matter of internal process) as opposed to trustworthy AI (a matter of independently verifiable real-world outcomes), and that it persists because of three compounding failures: (1) the market cannot distinguish trustworthy systems from their imitations; (2) evaluation targets models and outputs rather than deployed sociotechnical systems and their outcomes; (3) the measurement ecosystem is oriented toward avoiding harm rather than demonstrating benefit. Reviewing existing AI governance instruments and comparing them to certification regimes in healthcare, sustainability, and security, we show that none integrate a governance baseline, independently verified positive-outcome evidence, and market signaling in a single framework. We propose independent, outcome-oriented certification as the connective layer that can close the trust gap, complementing regulation and internal governance by making trustworthiness measurable, comparable, and commercially rewarded.

URL PDF HTML 收藏
2607.15404 2026-07-20 cs.IT cs.LG eess.SP math.IT 新提交

Closed-Loop Bayesian Bandit Encoder with GRAND Receiver for a Bursty Interference Channel

用于突发干扰信道的带GRAND接收机的闭环贝叶斯智能体编码器

Bhaskar Krishnamachari

机构 * Ming Hsieh Department of Electrical and Computer Engineering(明希学校电气与计算机工程系) Viterbi School of Engineering, University of Southern California(维特比工程学院,南加州大学)

AI总结 研究在有未知干扰源的信道上,随机线性码与跨码字交织码的分组级选择。采用GRAND接收机及贝叶斯估计器,通过折扣汤普森采样器选传输模式,经实验得出不同阶段模式偏好及模型优势,还给出误块率降低等成果。

Comments 11 pages, 6 figures. Simulation code available at https://github.com/ANRGUSC/BBE

详情
AI中文摘要

交织可减轻突发错误,但会引入解码延迟并消除信道感知解码器可利用的时间错误结构。我们考虑在具有未知数量开/关干扰源的信道上,在随机线性码和使用跨码字交织的相同码之间进行分组级选择。接收机使用具有可替换噪声模型的猜测随机加性噪声解码(GRAND),并将聚合信道统计信息反馈给发射机处的贝叶斯估计器。一旦估计出干扰幅度和定时参数,就会替换接收机的噪声模型:它计算隐马尔可夫模型后验比特翻转概率,并使用它们对GRAND查询进行排序。折扣汤普森采样器使用吞吐量减去延迟奖励在两种传输模式之间进行选择,其分布是内生非平稳的:接收机自适应而非信道变化会改变每种模式的值。在五个模拟种子中,在信道估计收敛之前,交织模式更受青睐。在激活学习到的解码器之后,非交织模式变得更可取,因为它在没有交织延迟的情况下实现了更低的误块率。在参考配置中,学习到的噪声模型相对于ORBGRAND将误块率降低了大约一个数量级。在完全收敛之前使用部分信道估计可将收敛前的误块率降低高达4.5倍。添加模型预测效用作为置信加权伪观测可将劣化臂的转换后选择减少约65%。在类似100 MHz 5G NR符号率的理想化空中时间转换下,学习瞬态对应于几毫秒的占用符号时间。

英文摘要

Interleaving mitigates burst errors but introduces decoding delay and removes temporal error structure that a channel-aware decoder could exploit. We consider packet-level selection between a random linear code and the same code used with cross-codeword interleaving, over a channel with an unknown number of on/off interferers. The receiver uses Guessing Random Additive Noise Decoding (GRAND) with a replaceable noise model and feeds aggregate channel statistics back to a Bayesian estimator at the transmitter. Once the interference amplitudes and timing parameters are estimated, the receiver's noise model is replaced: it computes hidden-Markov-model posterior bit-flip probabilities and uses them to order GRAND queries. A discounted Thompson sampler selects between the two transmission modes using a goodput-minus-latency reward whose distribution is endogenously nonstationary: receiver adaptation, rather than channel change, alters the value of each mode. Across five simulation seeds, the interleaved mode is preferred before channel estimation converges. After the learned decoder is activated, the non-interleaved mode becomes preferable because it achieves lower block error rate without interleaving delay. In the reference configuration, the learned noise model reduces block error rate by approximately one order of magnitude relative to ORBGRAND. Using partial channel estimates before full convergence reduces pre-convergence block error rate by up to $4.5\times$. Adding model-predicted utilities as confidence-weighted pseudo-observations reduces post-transition selection of the inferior arm by approximately $65\%$. Under an idealized airtime conversion at a 100~MHz 5G~NR-like symbol rate, the learning transient corresponds to a few milliseconds of occupied symbol time.

URL PDF HTML 收藏
2607.14491 2026-07-17 cs.SI cs.CL 新提交

Manufactured Divisiveness: Decomposing the Hostile Content of Seven Social Media Influence Operations

人为制造的分裂:剖析七种社交媒体影响行动中的恶意内容

Emilio Ferrara

机构 * Department of Computer Science University of Southern California(计算机科学系 美国南加州大学)

AI总结 研究推特中七种政府认定活动推文里的恶意内容,通过双提示大语言模型检测器和可审计规则区分仇恨与其他分裂形式,发现将所有相关内容计为仇恨会高估,有助于重新定义影响活动及在线话语中仇恨的研究。

详情
AI中文摘要

国家支持的影响行动通常被视为“仇恨”和“毒性”的高发来源。我们认为这些比率存在测量误差:背后的检测工具旨在捕捉更广泛的定义,包括针对外群体的敌意或分裂,因此将仇恨过度归因于更应被描述为党派或地缘政治谩骂的内容。我们从推特信息行动档案中七个政府认定的活动的2508万条推文里区分仇恨与其他形式的分裂。先验证了基于双提示大语言模型的检测器,然后制定了可审计规则,将内容分为三个子类别。研究发现将所有这些都报告为仇恨会高估约两倍,只有18.7%是基于身份且有辱人格或煽动性的。七个活动中的六个可分为三种模式,我们称之为“人为制造的分裂”。区分这些结构的界限仍未确定,研究结果有助于在影响活动和更广泛的在线话语背景下重新定义仇恨研究。

英文摘要

State-backed influence operations are routinely measured as high-prevalence sources of ``hate'' and ``toxicity.'' We argue those rates rest on a measurement error: the detectors behind them are validated to catch a broader definition inclusive of hostility or divisiveness aimed at an out-group, and so over-attribute hate to content better described as partisan or geopolitical invective. Across 25.08M tweets from seven government-attributed campaigns in the Twitter Information Operations archive (8,275 accounts), we separate hate from the other forms of divisiveness. We first validate a two-prompt LLM-based detector, matching human labels at Cohen's $κ=0.82$, to identify the broader hostility; we then develop an auditable rule, agreeing with an expert at $κ=0.52$, to further classify this content (5,457 posts) into three sub-categories. About 50.1% are identity-based attacks on people, whereas 30.4% are partisan attacks and 19.5% invective against states and their foreign policy. Reporting all of it as hate therefore overstates hate roughly twofold; only 18.7% is both identity-based and dehumanizing or inciting. Six of seven campaigns sort into three regimes that a single ``hate'' rate flattens, namely identity hate (RU-op and IRA, both Russia-attributed), geopolitical invective (both Iran operations), and partisan divisiveness (both Venezuela operations). We call the shared product $manufactured divisiveness$. The line to separate these constructs itself remains unsettled: on the hardest cases three independent human experts agree only moderately (pairwise $κ=0.37$--$0.50$), and the best of nineteen LLM models tops out at $κ=0.601$ against the experts' majority. Our findings can help redefine the study of hate in the context of influence campaigns and broader online discourse.

URL PDF HTML 收藏
2607.14159 2026-07-17 cs.AI cs.CL 新提交

MemoHarness: Agent Harnesses That Learn from Experience

MemoHarness:从经验中学习的智能体控制层

Yue Huang, Wenjie Wang, Han Bao, Yuchen Ma, Xiaonan Luo, Yi Nian, Haomin Zhuang, Zheyuan Liu, Yue Zhao, Xiangliang Zhang

机构 * University of Notre Dame(圣母大学) LMU Munich(慕尼黑大学) University of Southern California(南加州大学)

AI总结 研究针对智能体控制层设计影响行为但改进方法窄且多重用单一全局控制层的问题,提出自适应框架MemoHarness,通过分解控制层、存储经验并检索应用,在多基准测试中优于固定控制层,证明执行经验可构建更具适应性的控制层。

详情
AI中文摘要

智能体控制层是通过管理上下文、工具、编排、内存、解码和输出处理,将基础语言模型转变为可执行智能体的外部控制层。虽然控制层设计对智能体行为有重大影响,但多数自动改进方法针对提示、管道或工作流程等更窄的工件进行优化,且部署的智能体通常对所有情况都重用单一全局控制层。我们引入了MemoHarness,这是一个从自身执行中学习的自适应控制层优化框架。MemoHarness将控制层分解为六个可编辑的控制维度,在双层经验库中存储每个案例的诊断结果和提炼的全局模式,并利用检索到的经验将学习到的控制层应用于每个测试用例,无需测试时标签反馈或额外搜索。在我们对shell智能体、代码生成和分析推理基准的评估中,MemoHarness优于我们比较的固定控制层,并显示出向未见套件和基础模型的选择性迁移。当大部分检索到的经验可缓存时,其额外上下文也能保持成本竞争力。这些结果证明,执行经验是构建比单一静态配置更具适应性的智能体控制层的实用基础,而关于统计稳健性和组件归因的更广泛主张留待未来工作。

英文摘要

An agent harness is the external control layer that turns a base LLM into an executable agent by managing context, tools, orchestration, memory, decoding, and output handling. While harness design strongly affects agent behavior, most automatic improvement methods optimize narrower artifacts such as prompts, pipelines, or workflows, and deployed agents usually reuse a single global harness for all cases. We introduce MemoHarness, an adaptive harness optimization framework that learns from its own executions. MemoHarness decomposes the harness into six editable control dimensions, stores per-case diagnoses and distilled global patterns in a dual-layer experience bank, and adapts the learned harness to each test case using retrieved experience without test-time labels, feedback, or additional search. In our evaluation across shell-agent, code-generation, and analytical-reasoning benchmarks, MemoHarness improves over the fixed harnesses we compare against and shows selective transfer to unseen suites and base models. Its additional context can also remain cost-competitive when much of the retrieved experience is cacheable. These results provide evidence that execution experience is a practical substrate for building agent harnesses that are more adaptive than a single static configuration, while leaving broader claims about statistical robustness and component attribution to future work.

URL PDF HTML 收藏
2607.14304 2026-07-17 stat.ML cs.LG math.PR math.ST stat.TH 新提交

Spectral Concentration and Recovery in Sparse High-Dimensional Random Geometric Graphs

稀疏高维随机几何图中的谱集中与恢复

Manuel Fernandez, Yizhe Zhu

机构 * Department of Mathematics, University of Southern California(数学系,南加州大学)

AI总结 研究稀疏高维随机几何图,通过连接内积超阈值的向量对生成。证明了球面和高斯模型的谱范数界,改进恢复保证,还得到高斯混合块模型的精确恢复结果,采用新证明方法结合多种技术。

Comments 62 pages

详情
AI中文摘要

我们研究通过连接内积超过阈值的高维向量对生成的稀疏随机几何图。潜在向量从球体或标准高斯分布中均匀采样。尽管每条边出现概率为\(p\),但边通过共享潜在向量相关。对于球面模型,在连通性尺度\(np = \Omega(\log n)\)时,我们证明\(\|A - \mathbb{E}A\| = O(\sqrt{np\log n} + np\tau)\),概率很高,其中\(\tau\)是帽阈值,此结果在更弱假设下改进了Liu等人(2023)的谱范数界。高斯模型有类似结果,改进了齐次Kuramoto模型的全局同步保证。然后从主特征空间恢复潜在几何。当\(np\gg\log n\)时,在一定条件下潜在向量和相对Gram矩阵误差消失,改进了Li和Schramm(2023)的恢复保证。最后,我们证明了Li和Schramm(2023)的高斯混合块模型的第一个精确恢复结果。在最优连通性尺度\(np = \Omega(\log n)\)时,多项式时间半定规划在中等分离区域能精确恢复所有标签,更大分离则因孤立顶点大概率出现而无法精确恢复。我们的证明结合了正交多项式展开、解耦和矩阵集中,避免了先前工作中使用的迹矩论证。

英文摘要

We study sparse random geometric graphs generated by connecting pairs of high-dimensional vectors whose inner product exceeds a threshold. The latent vectors are sampled either uniformly from the sphere or from a standard Gaussian distribution. Although every edge appears with probability $p$, the edges are dependent through their shared latent vectors. For the spherical model, at the connectivity scale $np=Ω(\log n)$, we prove $\|A-\mathbb E A\|=O\left(\sqrt{np\log n}+npτ\right)$, with high probability, where $τ$ is the cap threshold. This sharpens the spectral norm bound of Liu, Mohanty, Schramm, and Yang (2023) under weaker assumptions. An analogous result holds for the Gaussian model after removing the fluctuations of the vector norms, yielding improved global synchronization guarantees for the homogeneous Kuramoto model. We then recover the latent geometry from the leading eigenspace. When $np\gg\log n$, both the latent vector and relative Gram matrix errors vanish provided $d\ll np\log(1/p)/\log n$. The required lower dimension is only $d\gg\log(1/p)$ for the spherical model and $d\gg\log^2(1/p)\log n$ for the Gaussian model, improving the recovery guarantees of Li and Schramm (2023). Finally, we prove the first exact recovery result for the Gaussian mixture block model of Li and Schramm (2023). At the optimal connectivity scale $np=Ω(\log n)$, a polynomial-time semidefinite program exactly recovers all labels in a moderate-separation regime, whereas larger separation makes exact recovery impossible because isolated vertices appear with high probability. Our proofs combine orthogonal polynomial expansions, decoupling, and matrix concentration, avoiding the trace-moment arguments used in previous work.

URL PDF HTML 收藏
2509.00761 2026-07-17 cs.AI cs.CL 版本更新

L-MARS: Legal Multi-Agent System with Agentic Search and Citation-Faithfulness Audit

L-MARS:具有协调推理和代理搜索的法律多智能体工作流

Boqin Yuan, Ziqi Wang

机构 * University of Southern California(南加州大学) University of California, San Diego(加利福尼亚大学圣迭戈分校)

AI总结 L-MARS是一种多代理检索框架,通过分解查询为结构化子问题,利用代理网络搜索获取证据,并通过验证代理过滤结果,从而在法律问答中实现高准确率。

Comments Accepted at the AI4Law Workshop at ICML 2026

详情
AI中文摘要

我们提出了L-MARS(具有协调推理和代理搜索的法律多智能体工作流),一种用于基于事实的法律问答的多代理检索框架,它将查询分解为结构化子问题,通过代理网络搜索获取证据,通过验证代理过滤结果,并综合引用答案。现有的法律问答基准测试要么测试封闭书推理,要么测试固定语料库上的检索,但两者都无法捕捉需要当前法律信息的场景。我们引入了LegalSearchQA,一个包含50个问题的跨五个法律领域的基准测试,其答案依赖于模型训练数据之后的最新发展。L-MARS在LegalSearchQA上实现了96.0%的准确率,比零样本性能(58.0%)提高了38.0%,而链式思维提示使性能下降到30.0%。在Bar Exam QA(Zheng等,2025)上,一个专注于推理的594个法考问题基准测试中,检索提供微弱的提升(+0.7个百分点),与先前发现一致。这些结果表明,当任务需要最新事实知识时,代理检索显著提高了法律问答的性能,但收益取决于基准测试,凸显了需要检索导向评估的必要性。代码和数据可在:https://github.com/boqiny/L-MARS获取。

英文摘要

Large language models are increasingly deployed for legal question answering, where evaluations typically focus on multiple-choice accuracy. This measure overlooks a common failure: whether the citation source attached to an answer exists and supports the rule the system attributes to it. We present L-MARS, an open multi-agent legal QA system with agentic search and judge-driven evidence checks, and audit it claim by claim against its cited source. Each atomic claim is labelled with a six-class taxonomy and scored with strict-ALCE under cross-provider judging, where the answerer and verifier come from different model families. On a stratified 100-question Bar Exam audit, retrieval barely moves accuracy, yet the multi-turn judge loop lifts strict citation F1 from 0.13 (naive RAG) to 0.25 and cuts the no-citation rate from 34% to 13%. We further introduce Faith-Search, a post-draft step that re-verifies and repairs unreachable citations; it drops the unreachable rate below 1% but does not improve F1 over the multi-turn loop, so we report it as a targeted reachability intervention rather than a faithfulness breakthrough. A 50-question LegalSearchQA case study confirms the picture: retrieve-then-draft pipelines saturate near 0.75 citation F1, while a single-agent web-search baseline collapses to 0.22 under external audit.

URL PDF HTML 收藏
2601.07944 2026-07-17 stat.ML cs.LG stat.CO 版本更新

Neural Architectures for Amortized Bayesian Inference: Statistical Foundations and Empirical Assessments

用于摊销贝叶斯推理的神经架构:统计基础与实证评估

Roy Shivam Ram Shreshtth, Arnab Hazra, Gourab Mukherjee

机构 * Department of Mathematics and Statistics, Indian Institute of Technology Kanpur(数学与统计学系,印度理工学院坎浦尔分校) Marshall School of Business, University of Southern California(马歇尔商学院,南加州大学)

AI总结 探讨用于摊销贝叶斯推理的神经架构,从统计角度分析前馈网络等架构如何支持摊销推理,通过模拟研究评估其在不同场景下的表现,展现其优势与局限。

Comments 32 pages, 8 figures, 3 tables

详情
AI中文摘要

自世纪之交以来,随着新的计算技术被纳入以处理日益复杂的大规模预测问题,近似贝叶斯推理不断发展。深度神经网络和基础模型的成功催生了统计建模的新范式,即通过大规模学习预测器摊销贝叶斯推理。摊销推理开始时训练神经网络需大量计算,但后续能以较低成本在广泛任务中产生近似后验或预测。本文从统计角度探讨了几种主要神经架构如何支持摊销贝叶斯推理,通过模拟研究评估了其在不同场景下的准确性、鲁棒性和不确定性量化等。

英文摘要

Since the turn of the century, approximate Bayesian inference has steadily evolved as new computational techniques have been incorporated to handle increasingly complex, large-scale predictive problems. The recent success of deep neural networks and foundation models has now given rise to a new paradigm in statistical modeling, in which Bayesian inference can be amortized through large-scale learned predictors. In amortized inference, substantial computation is required at the beginning to train a neural network, but it can subsequently produce approximate posteriors or predictions at much lower computational cost across a wide range of tasks. While the typical Bayesian inference procedures are computationally expensive due to repeated likelihood calculations and Monte Carlo steps for each new dataset, amortized inference provides a much lower computational cost at deployment. Despite the growing popularity of amortized inference, its statistical interpretation and position within Bayesian inference remain poorly explored. In this paper, we present a statistical perspective on several major neural architectures, including feedforward networks, Deep Sets, and Transformers, and examine how they naturally support amortized Bayesian inference. We explore how these models perform structured approximation and also probabilistic reasoning in ways that yield controlled generalization error throughout a wide range of deployment scenarios, and how these properties can be harnessed for Bayesian computation. Via simulation studies, we evaluate the accuracy, robustness, and uncertainty quantification of amortized inference across varying sample sizes, varying noise distributional families, varying sparsity levels, and multimodality, highlighting its strengths and limitations.

URL PDF HTML 收藏
2507.03209 2026-07-17 q-bio.QM cs.CE cs.LG q-bio.MN 版本更新

A Machine Learning Benchmarking Framework for Lipid Nanoparticle Transfection Efficiency Prediction

用于脂质纳米颗粒转染效率预测的机器学习基准框架

Asal Mehradfar, Mohammad Shahab Sepehri, Jose Miguel Hernandez-Lobato, Glen S. Kwon, Mahdi Soltanolkotabi, Salman Avestimehr, Morteza Rasoulianboroujeni

机构 * Department of Electrical and Computer Engineering, University of Southern California(电气与计算机工程系,南加州大学) University of Cambridge(剑桥大学) School of Pharmacy, University of Wisconsin-Madison(威斯康星大学麦迪逊分校药学院) University of Wisconsin-Madison(威斯康星大学麦迪逊分校) East Tennessee State University(东田纳西州立大学)

AI总结 研究针对脂质纳米颗粒转染效率预测,提出机器学习基准框架,系统测试不同分子表示与机器学习架构,用特定数据集评估模型,显示利用显式分子子结构编码的模型准确性最高,为相关预测模型发展建立基线。

Comments Published in Communications AI & Computing (Nature Portfolio), 2026

Journal ref Commun. AI Comput. 1, 2 (2026)

详情
AI中文摘要

新的可电离脂质的发现是RNA疗法发展的主要瓶颈。机器学习模型可直接根据脂质结构预测转染效率,但缺乏严格的基准测试。本文提出了一个强大的机器学习基准框架,用于评估基于可电离脂质结构的转染预测模型。该框架系统地对不同分子表示与广泛的机器学习架构进行基准测试,支持模型泛化评估和超越标准回归指标的预测可靠性评估。通过一个精心策划的数据集表明,利用显式分子子结构编码的模型具有最高预测准确性,而一些当前基于图的模型准确性较低。该框架为脂质基RNA递送预测模型的未来发展建立了强大的基线。

英文摘要

The discovery of new ionizable lipids for efficient lipid nanoparticle (LNP)-mediated RNA delivery remains a major bottleneck in RNA therapeutics development. Recent advances demonstrate the potential of machine learning (ML) models to predict transfection efficiency directly from lipid structure, enabling high-throughput virtual screening and accelerating lead identification. However, as new models for LNP transfection prediction continue to emerge, the lack of rigorous and standardized benchmarking poses a significant risk and may undermine confidence in their reliability for discovery. Here, we present a robust ML benchmarking framework for evaluating transfection prediction models based on ionizable lipid structures. This framework systematically benchmarks diverse molecular representations paired with a broad range of ML architectures spanning traditional models, feedforward neural networks, and state-of-the-art graph-based methods. In addition, the presented framework supports assessment of model generalization and evaluates prediction reliability beyond standard regression metrics. Using a curated dataset of 1,100 unique ionizable lipid structures derived from the HeLa transfection dataset originally reported by Xu et al., we show that within this framework, models leveraging explicit molecular substructure encoding consistently achieve the highest predictive accuracy and should serve as essential baselines for the development of new, more sophisticated models. In contrast, some current graph-based models, including AGILE, Chemprop, and KPGT, tend to show comparatively lower accuracy. The presented framework provides a standardized, transparent, and comprehensive benchmarking resource that enables meaningful comparison of emerging architectures and establishes strong baselines for future development of predictive models in lipid-based RNA delivery.

URL PDF HTML 收藏
2607.13298 2026-07-16 cs.CV 新提交

FOLIO: Focused Semantic Memory for Streaming Video Understanding

FOLIO:用于流视频理解的聚焦语义记忆

Haoyang Fan, Dhruv Parikh, Anvitha Ramachandran, Sameh Gobriel, Nilesh Jain, Rajgopal Kannan, Viktor Prasanna

机构 * University of Southern California (USC)(南加州大学) Intel Labs(英特尔实验室) DEVCOM Army Research Office(陆军研究办公室)

AI总结 研究在线流视频理解中如何保留信息及组织历史记录的挑战,提出FOLIO聚焦语义记忆系统,通过动态聚焦状态更新记忆,结合短期视觉缓冲区与长期语义记忆,实现轻量级混合检索,提升性能并降低流记忆维护成本。

Comments 28 pages, 5 figures

详情
AI中文摘要

在在线流视频理解中,视频流持续到达且随时可能有查询。由于流帧无界增长,系统必须持续压缩并保留来自观察到的视频前缀的信息,而未来帧和查询未知。核心挑战是决定保留什么信息以及如何组织维护的历史记录。为应对此挑战,我们引入FOLIO,一个无需训练的聚焦语义记忆系统,它更详细地记录流的重要部分,同时保持周围上下文紧凑。流到达时,FOLIO在动态聚焦状态引导下在段级别更新记忆,结合短期视觉缓冲区和围绕观察到的实体组织并链接到视觉证据缓存的长期语义记忆。查询时,轻量级混合检索将结构化记忆上的直接匹配与语义查询扩展相结合。FOLIO实现了最优性能,在OVO - Bench上使用Qwen3 - VL - 8B达到82.0/69.1感知/向后准确率,在StreamingBench上总体准确率为74.5,同时通过为聚焦实体保留详细记录并紧凑存储周围上下文大幅降低了维护流记忆的成本。

英文摘要

In online streaming video understanding, a video stream continues to arrive and queries may be issued at any time. Because streaming frames grow without bound, the system must continuously compress and retain information from the observed video prefix while future frames and future queries remain unknown. The core challenge is deciding what information to retain and how to organize the maintained history: as this history grows with the stream, memory cost increases and many redundant visual details are retained, whereas later queries often depend on specific entities, actions, and their temporal changes. To address this challenge, we introduce FOLIO, a training-free focused semantic memory system that records important parts of the stream in higher detail while keeping surrounding context compact. As the stream arrives, FOLIO updates memory at the segment level, guided by a dynamic focus state, combining a short-term visual buffer with a long-term semantic memory organized around observed entities and linked to a visual-evidence cache. At query time, lightweight hybrid retrieval combines direct matching over the structured memory with semantic query expansion. FOLIO achieves state-of-the-art performance, reaching 82.0/69.1 Perception/Backward accuracy on OVO-Bench with Qwen3-VL-8B and 74.5 overall accuracy on StreamingBench, while substantially reducing the cost of maintaining streaming memory by reserving detailed records for focused entities and storing surrounding context compactly.

URL PDF HTML 收藏
2607.13048 2026-07-16 cs.LG cs.AI stat.ML 新提交

Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems

流系统中事件触发大语言模型调用的不确定性感知序贯决策规则

Zhaohui Wang

机构 * Viterbi School of Engineering, University of Southern California(南加州大学维特比工程学院)

AI总结 研究流系统中何时调用大语言模型的问题,将其转化为基于风险的序贯停止问题,证明了相关理论结果。通过在涡轮风扇退化数据上的实验,验证假设、比较基线,得出次线性遗憾、高诊断质量等结论,表明异常分数驱动的风险函数更优。

Comments 18 pages, 5 figures. Accepted to the ECML PKDD 2026 Research Track

详情
AI中文摘要

流推理管道越来越多地将轻量级快速模型与成本高昂但能提供丰富语义理解的大语言模型(LLM)相结合。何时调用LLM这一核心问题尚未得到充分的形式化处理。我们将其视为基于风险的序贯停止问题,当观测历史上的风险函数超过阈值时触发策略。在此框架下,我们证明了六个结果,包括排除触发抖动的最小事件间隔时间界限、阈值策略的最优性等。一些经典触发族可表示为此框架的特殊情况。在有实际LLM调用的涡轮风扇退化数据(CMAPSS)上,我们验证了理论假设,消融了风险函数设计,与六个基线进行比较,并分析了成本敏感性和LLM故障模式。结果证实了次线性遗憾,所有原则性触发的α<1;高诊断质量,在我们的标准下,1600次LLM诊断中有92.9%达到接地分数>=0.75;以及异常分数驱动的风险函数在帕累托AUC上比其他方法占优约一个数量级。

英文摘要

Streaming inference pipelines increasingly pair lightweight fast models with Large Language Models (LLMs) that provide rich semantic understanding at substantial cost. The central question of when to invoke the LLM has received limited formal treatment. We cast this as a risk-based sequential stopping problem, where a trigger policy fires when a risk functional over the observation history exceeds a threshold. Within this framework, we prove six results: a minimum inter-event time bound excluding trigger chattering; optimality of threshold policies via smooth pasting; approximate SPRT guarantees under estimated parameters; O(sqrt(T log T)) regret for stationary streams, extending to O(sqrt((C_T + 1) T log T)) under C_T changepoints; O(1/sqrt(T)) convergence of online gradient descent for adaptive thresholds; and a calibration-to-miss-rate transfer inequality. Several classical trigger families, including event-triggered, optimal stopping, SPRT, CUSUM, and Bayesian triggers, can be expressed as special cases of this framework. On turbofan degradation data (CMAPSS) with real LLM calls, we empirically verify the theoretical assumptions, ablate the risk function design, compare against six baselines including a RouteLLM-style router and contextual bandits, and analyze cost sensitivity and LLM failure modes. The results confirm sublinear regret, with alpha < 1 for all principled triggers; high diagnostic quality, with 92.9 percent of 1600 LLM diagnoses reaching grounding score >= 0.75 under our rubric; and that anomaly-score-driven risk functions dominate alternatives by roughly an order of magnitude on the Pareto AUC.

URL PDF HTML 收藏
2607.13174 2026-07-16 physics.comp-ph cs.CE cs.RO 新提交

Towards end-to-end optimization in multimaterial 3D printing

迈向多材料3D打印中的端到端优化

Xue-Ling Luo, Steven Yang, Jingye Tan, Robert F. Shepherd, Noy Cohen, Nikolaos Bouklas

机构 * addressline= Sibley School of Mechanical Aerospace Engineering, Cornell University , city= Ithaca , state= NY , country= USA addressline= Department of Aerospace \& Mechanical Engineering, University of Southern California , city= Los Angeles , state= CA , country= USA addressline= Department of Materials Science Engineering, Technion - Israel Institute of Technology , city= Haifa , country= Israel addressline= Pasteur Labs , city= Brooklyn , state= NY , country= USA

AI总结 针对多材料3D打印中优化空间材料分布与结构拓扑的难题,提出将稀疏物理增强神经网络与有限元拓扑优化集成的端到端框架,通过提取本构定律实现精确微分,应用于软机器人抓手,可取代经验原型制作,建立实用的机器学习设计模型。

详情
AI中文摘要

多材料3D打印能够制造功能梯度部件,但由于高维设计空间和复杂的本构建模,在优化其空间材料分布和结构拓扑方面仍然是一个巨大挑战。本文提出了一个端到端计算框架,将稀疏物理增强神经网络与基于有限元的拓扑优化相结合。通过从实验数据中提取封闭形式、成分感知的超弹性本构定律,该方法借助FEniCSx实现的伴随状态法促进精确符号微分,有效规避应用神经网络本构模型的瓶颈。该流程应用于软机器人抓手应用,展示了针对高度各向异性接触响应的连续成分优化,以及在非失效拉伸约束下宏观拓扑和材料分布的协同优化。这种方法可以取代费力的经验原型制作,将可解释的机器学习模型确立为先进多材料增材制造实用、稳健的设计原语。

英文摘要

Multimaterial 3D printing enables the fabrication of functionally graded components, but optimizing their spatial material distribution alongside structural topology remains a formidable challenge due to high-dimensional design spaces and complex constitutive modeling. This paper presents an end-to-end computational framework integrating sparsified physics-augmented neural networks with finite-element-based topology optimization. By extracting closed-form, composition-aware hyperelastic constitutive laws from experimental data, this approach facilitates exact symbolic differentiation via the adjoint state method implemented with FEniCSx, efficiently circumventing the bottlenecks of applying neural network constitutive models. This pipeline is deployed on soft robotic gripper applications, demonstrating continuous composition optimization for highly anisotropic contact responses, and the concurrent optimization of macroscopic topology and material distribution under non-failure stretch constraints. This methodology could replace laborious empirical prototyping, establishing interpretable machine-learning models as practical, robust design primitives for advanced multimaterial additive manufacturing.

URL PDF HTML 收藏