一个通用悬崖与一个设计指纹:LLM编排下的跨段缺陷检测
A Universal Cliff and a Design Fingerprint: Cross-Section Defect Detection Under LLM Orchestration
AI总结:
本研究揭示在LLM编排下,所有模型检测跨段矛盾缺陷的能力大幅下降(检测率降低三分之二以上),并发现不同对齐范式下的模型行为差异,其中一家开发商的模型随对齐增强呈现报告标准偏移。
摘要:
生产级语言模型系统通过将请求分解为不可见的编排工作代理(这些代理重新组合成一份综合报告)来回答请求。我们探究这对一类单个代理无法察觉的缺陷——文档中两个远距离段落之间关系的矛盾——有何影响。保持文档、缺陷、机制、评分和种子不变,我们仅改变模型:来自同一开发商的五代的十个系统,以及来自不同对齐范式的五个提供商。 两个层次分离。首先,一个通用检测悬崖:每个在单代理下能发现这些跨段缺陷的模型,在编排下失去该能力,检测率在所有测试的范式中下降三分之二或更多。该悬崖源于机制,无法通过规模或扩展推理弥补。其次,模型跌落后的行为方式。信号检测分解显示,在六个高于随机水平的判别模型中,只有一家开发商的模型沿报告标准轴移动:随着对齐增强,模型漏检更少缺陷,但在干净文档上引发更多误报——这是同一标准偏移的两个方面,在该开发商内部随代际缩放(p < 0.001),而在其他地方几乎不存在。 在底层,漏检的缺陷往往并非不可见:模型的私有记录准确重构了结构故障,而综合报告却确认其完好,其关注点放在工件和缺失的合作者上。这难以量化——自动评判不稳定(精确率17-50%),关键词也无法将其与普通同意区分——我们将这种抵抗作为一项发现报告。我们发布所有运行、探针、缺陷密钥、评分提示和脚本。综合报告的置信度对跨分区缺陷无信息量,最对齐的系统并非最安全,而悬崖是结构性的。
英文摘要:
Production language-model systems answer a request by partitioning it across an invisible orchestration of worker agents that recompose one integrated report. We ask what this does to a class of defect no single worker can see: a contradiction in the relation between two distant sections of a document. Holding the documents, defects, mechanism, scoring, and seed fixed, we vary only the model -- ten systems across five generations from one developer and five providers from distinct alignment paradigms. Two layers separate. First, a universal detection cliff: every model that finds these cross-section defects under a single agent loses that ability under orchestration, detection falling two-thirds or more across every paradigm tested. The cliff is mechanism-derived and not closed by scale or extended reasoning. Second, how models behave once fallen. A signal-detection decomposition shows that, among the six models discriminating above chance, only one developer's generations move along the reporting-criterion axis: as alignment is strengthened, the model misses fewer defects yet raises more false alarms on clean documents -- two faces of one criterion shift, scaling with generation within that developer (p < 0.001) and near-absent elsewhere. At the floor the missed defect is often not out of view: the model's private record reconstructs the structural fault accurately, while the integrated report signs off on its soundness, its concern spent on the artifact and an absent collaborator. This resists quantification -- an automated judge is unstable (precision 17-50%) and keywords cannot separate it from ordinary agreement -- a resistance we report as a finding. We release all runs, probes, defect keys, scorer prompts, and scripts. An integrated report's confidence is uninformative about partition-spanning defects, the most aligned systems are not the safest, and the cliff is structural.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。