arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.22300cs.AIcs.LGcs.MA

跨领域基准测试揭示协调AI代理在部分证据下提升科学推断何时有效

Cross-domain benchmarks reveal when coordinated AI agents improve scientific inference from partial evidence

Laboratory for Atomistic and Molecular Mechanics (LAMM)(原子分子力学实验室);Department of Biological Engineering(生物工程系);Department of Mechanical Engineering(机械工程系);Department of Civil and Environmental Engineering(土木与环境工程系);Center for Computational Science and Engineering, Schwarzman College of Computing(计算科学与工程中心);Massachusetts Institute of Technology(麻省理工学院)

Fiona Y. Wong, Markus J. Buehler

AI总结:

本文通过跨领域基准测试探讨协调AI代理在部分证据下提升科学推断的有效性,发现当不同学科各自捕捉现象部分时,跨通道复合方法优于单一通道基线,但在某些情况下分解并不总是提升整体性能。

摘要:

科学证据通常跨越仪器、数据库和学科,因此没有单一来源能完整记录现象。这使得确定协调AI代理何时能超越简单科学工作流变得困难。我们通过涵盖四个科学任务的跨领域基准测试评估了这一问题:将分子结构映射到音乐表示、检测科学历史范式转变、识别媒介传播疾病爆发以及验证行星凌星候选体。每个案例均使用冻结评估小组、预定义评分协议、明确基线、消融或零对照,以及声明的限制。结果定义了三个操作模式。当不同学科各自只捕捉现象部分时,跨通道复合方法优于单一通道基线:气候-媒介爆发达到AUROC 0.944,行星凌星验证达到AUROC 0.955。然而,行星凌星工作流与强联合摘要基线几乎持平,表明分解不总能提升整体性能。当一个信号主导时,如范式转变检测,协调主要提升解释和可追溯性。对于分子音乐化,收益是表征而非预测性的。ScienceClaw x Infinite提供了此评估的可审计艺术ifacts和来源层。因此,该基准测试仅在对应的性能、来源或表征主张有明确比较器支持时才赋予协调价值。

英文摘要:

Scientific evidence often spans instruments, databases, and disciplines, so no single source records the full phenomenon. This makes it difficult to determine when coordinated AI agents add value over simpler scientific workflows. We evaluate this question with a cross-domain benchmark spanning four scientific tasks: mapping molecular structure into musical representations, detecting historical paradigm shifts in science, identifying vector-borne disease emergence, and vetting transiting-exoplanet candidates. Each case uses a frozen evaluation panel, predefined scoring protocols, explicit baselines, ablations or null controls, and stated limitations. The results define three operating regimes. When different disciplines each capture only part of the phenomenon, cross-channel composites improve over single-channel baselines: climate-vector emergence reaches AUROC 0.944 and exoplanet vetting reaches AUROC 0.955. However, the exoplanet workflow is effectively tied with a strong combined-summary baseline, showing that decomposition does not always improve top-line performance. When one signal dominates, as in paradigm-shift detection, coordination mainly improves interpretation and traceability. For molecular sonification, the gain is representational rather than predictive. ScienceClaw x Infinite provides the auditable artifact and provenance layer for this evaluation. The benchmark therefore assigns value to coordination only when the corresponding performance, provenance, or representation claim is supported by explicit comparators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑