思想有基因组：科学谱系推理与基于谱系的思想生成基准测试
Ideas Have Genomes: Benchmarking Scientific Lineage Reasoning and Lineage-Grounded Idea Generation
AI总结：
该研究提出IG-Bench基准测试，用于科学谱系推理与基于谱系的思想生成。围绕IdeaGene框架构建，支持两种评估。通过对14个基于大语言模型的科学家实验，发现存在组合瓶颈，最强系统谱系推理精确准确率低，结构化谱系上下文改变系统排名。
摘要：
科学思想很少从零开始。它们像生物基因组一样继承机制、修复已知局限并重组早期工作片段。当前基准测试对人工智能系统能否遵循这种继承结构涉及甚少。我们提出了IdeaGene-Bench（IG-Bench），这是一个用于科学谱系推理和基于谱系的思想生成的基准测试。IG-Bench围绕IdeaGene框架构建，包含多种元素和记录，支持两种评估。对14个基于大语言模型的科学家进行实验，发现存在组合瓶颈，最强系统在谱系推理上的精确准确率仅为27.3%，结构化谱系上下文会改变系统排名。
英文摘要：
Scientific ideas rarely start from a blank page. They inherit mechanisms, repair known limitations, and recombine pieces of earlier work, much like biological genomes. Current benchmarks still say little about whether AI systems can follow this inheritance structure. We present IdeaGene-Bench (IG-Bench), a benchmark for scientific lineage reasoning and lineage-grounded idea generation. IG-Bench is organized around the IdeaGene framework: each paper or proposal is represented as a set of minimal, typed, evidence-grounded Idea Genome objects, and a GenomeDiff aligns these objects to record inheritance, mutation, loss, external import, and novel insertion under six operational evolutionary dynamics. The benchmark contains 1,961 golden lineage traces, 1,085 curated Idea Genome objects, and 920 pairwise GenomeDiff records across 10 scientific domains. It supports two evaluations. IG-Exam (42 task types, 1,029 instances) tests closed-form lineage reasoning across Idea Genome abstraction, inheritance tracing, evolutionary reasoning, and lineage verification. IG-Arena evaluates generation with a lineage-conditioned Population-Evolution Score(PES), asking whether a proposal can be inserted as a coherent descendant of a given lineage population: it should inherit the right Idea Genome objects, vary meaningfully from nearby work, and offer selection value for future research. Experiments on 14 LLM-based scientists expose a compositional bottleneck. The strongest system reaches only 27.3% exact accuracy on lineage reasoning, and structured lineage context reshuffles system rankings rather than helping every participant uniformly.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
