Contemporary automated scientific discovery has focused on agents for generating scientific experiments, while systems that perform higher-level scientific activities such as theory building remain underexplored. In this work, we formulate the problem of synthesizing theories consisting of qualitative and quantitative laws from large corpora of scientific literature. We study theory generation at scale, using 13.7k source papers to synthesize 2.9k theories, examining how generation using literature-grounding versus parametric knowledge, and accuracy-focused versus novelty-focused generation objectives change theory properties. Our experiments show that, compared to using parametric LLM memory for generation, our literature-supported method creates theories that are significantly better at both matching existing evidence and at predicting future results from 4.6k subsequently-written papers
ScImage: How Good Are Multimodal Large Language Models at Scientific Text-to-Image Generation?
University of Twente(特文特大学);University of Technology Nuremberg (UTN)(纽伦堡工业大学(UTN));University of Sheffield(谢菲尔德大学);Harbin Institute of Technology(哈尔滨工业大学);University of Mannheim(曼海姆大学);Technische Universität Dresden(德累斯顿工业大学)
Generative causal testing to bridge data-driven models and scientific theories in language neuroscience
Computer Science Department, University of Texas at Austin(德克萨斯大学计算机科学系);Microsoft Research(微软研究院);Neurosurgery Department, University of California(加州大学神经外科系);EECS Department, University of California(加州大学电子工程与计算机科学系);Statistics Department, University of California(加州大学统计学系);Center for Computational Biology, University of California(加州大学计算生物学中心);Neuroscience Department, University of California(加州大学神经科学系)
AIGS: Generating Science from AI-Powered Automated Falsification
Department of Computer Science & Technology, Tsinghua University(清华大学计算机科学与技术系);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院)
The Use of AI-Robotic Systems for Scientific Discovery
Chalmers University of Technology(查尔姆斯理工大学);The University of Manchester(曼彻斯特大学);KTH Royal Institute of Technology(皇家理工学院);Vanderbilt University(范德比大学);University of Cambridge(剑桥大学)
ReviewRL: Towards Automated Scientific Review with RL
Tsinghua University(清华大学);University of Washington(华盛顿大学);Shanghai AI Laboratory(上海人工智能实验室);Peking University(北京大学);Harbin Engineering University(哈尔滨工程大学);Beijing Institute of Technology(北京理工大学)
SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation
The University of Tokyo(东京大学);Tokyo Institute of Technology(东京工业大学);National Institute of Advanced Industrial Science Technology(日本产业技术综合研究所)
在科学论文中生成文本不仅需要捕获给定输入中包含的内容,还需要经常获取称为\textit{context}的外部信息。我们提出了一个新的任务,即科学领域的\textbf{context-aware text generation},旨在开发语境在生成文本中的贡献,从而推动了科学文本的生成。为此,我们为Conte \textbf{X} t-Aware Text \textbf{Gen} eration(SciXGen)提出了一个新的具有挑战性的大规模\textbf{Sci}有效论文数据集,由注释良好的205,304篇论文组成,其中充分引用了广泛使用的对象(例如,表、图、算法)。我们使用最先进的技术,对我们新构建的SciXGen数据集在生成描述和段落方面的功效进行了全面的基准测试。我们的数据集和基准将公开提供,希望能促进科学文本生成研究。
Generating Knowledge Graphs by Employing Natural Language Processing and Machine Learning Techniques within the Scholarly Domain
University of Cagliari(卡利亚里大学);FIZ Karlsruhe - Leibniz Institute for Information Infrastructure(FIZ卡尔斯鲁厄——莱布尼茨信息基础设施研究所);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);The Open University(开放大学);CNRS(法国国家科学研究中心);University Paris 13(巴黎第十三大学)
Do Large Multimodal Models Solve Caption Generation for Scientific Figures? Lessons Learned from SciCap Challenge 2023
Pennsylvania State University(宾夕法尼亚州立大学);National Tsing Hua University(国立清华大学);AllSci(奥尔赛公司);MetaMetrics Inc.(美塔麦特里克公司);Adobe Research(奥多比研究院);Institute of Information Science, Academia Sinica(中央研究院资讯科学研究所)