BioPhys-Bridge：物理驱动的生物学研究中跨学科科学推理的基准
BioPhys-Bridge: A Benchmark for Interdisciplinary Scientific Reasoning in Physics-Grounded Biological Research
浏览论文内容
中文总结 AI 辅助
BioPhys-Bridge是一个跨学科基准，用于评估语言模型在物理驱动的生物医学文献中的证据接地推理，包含500个案例和1,517个任务，初步评估显示DeepSeek-V4-Flash表现最佳。
中文摘要 AI 辅助
语言模型在分析跨学科科学研究文献时面临独特的挑战。在生物物理学研究中，忠实的回答需要将观察到的数据基于源证据，通过定量物理模型进行解释，并将其与生物学机制联系起来。为了解决这一挑战，我们引入了BioPhys-Bridge，一个用于生物物理文献上基于证据的科学推理的新型基准数据集。每个案例包含证据块、稳定的证据ID、定量值、单位、方程、假设、机制和下一步决策，作为问答（QA）和检索增强生成（RAG）的接地目标。初始版本包含500个案例，1,517个面向智能体的任务，涵盖六个生物学领域和九个物理模型家族，其中三个稀疏家族保留用于未来扩展。我们对所有案例在模式、证据完整性、定量接地、源许可、重复、单位标准化方面执行严格的质量门控，并对81个案例进行了领域专家审查和注释。初步评估显示，DeepSeek-V4-Flash获得了最高的证据ID F1分数（0.360），其次是Qwen3.7-Max（0.316）和GPT-4o-mini（0.294）。BioPhys-Bridge是一个跨学科基准，用于评估归因、忠实性、幻觉减少以及具有复杂多步科学推理的生物学实验设计。未来工作将增加数据集的规模和复杂性，并进行全面评估。代码和数据可在GitHub仓库和Hugging Face上获取。
英文摘要
Language models face unique challenges in analyzing interdisciplinary scientific research literature. In biophysics research, faithful answers require grounding observed data in source evidence, interpreting it through a quantitative physics model, and linking it to a biological mechanism. To address this challenge, we introduce BioPhys-Bridge, a novel benchmark dataset for evidence-grounded scientific reasoning over biophysical literature. Each case contains evidence blocks, stable evidence IDs, quantitative values, units, equations, assumptions, mechanisms, and next decisions as grounding targets for question answering (QA) and retrieval-augmented generation (RAG). The initial release contains 500 cases, 1,517 agent-facing tasks, and covers six biological domains and nine physical model families, including three sparse families reserved for future expansion. We enforce strict quality gates for all cases in schema, evidence-integrity, quantitative-grounding, source-license, duplicate, unit-normalization, with domain expert review and annotation for 81 cases. Preliminary evaluations show that DeepSeek-V4-Flash obtain the highest evidence-ID $F_1$ score (0.360), followed by Qwen3.7-Max (0.316) and GPT-4o-mini (0.294). BioPhys-Bridge is an interdisciplinary benchmark for evaluating attribution, faithfulness, hallucination reduction, and biological experiment design with complex, multi-step scientific reasoning. Future works will increase the size and complexity of the dataset and perform comprehensive evaluations. Code and data are available in the GitHub repository and on Hugging Face.
