arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.13610cs.CLcs.AIcs.LG
收藏

基于大型生成模型的数据驱动发现

Data-driven Discovery with Large Generative Models

Allen Institute for AI(艾伦人工智能研究所);OpenLocus;University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);University of Utah(犹他大学)

Bodhisattwa Prasad Majumder, Harshit Surana, Dhruv Agarwal, Sanchaita Hazra, Ashish Sabharwal, Peter Clark

AI总结:

本文倡导利用大型生成模型构建端到端数据驱动发现系统,并以基于GPT-4的DATAVOYAGER概念验证展示其潜力与局限,提出防故障工具集成和用户反馈调节以提升可靠性。

摘要:

随着数据以前所未有的速度积累,其推动科学发现的潜力正呈指数级增长。本立场论文敦促机器学习(ML)社区利用大型生成模型(LGM)的能力,开发用于端到端数据驱动发现的自动化系统——这一范式涵盖仅从一组提供的数据集中搜索和验证假设,而无需额外的数据收集或物理实验。我们首先概述了理想数据驱动发现系统的若干期望特性。然后,通过DATAVOYAGER这一利用GPT-4的概念验证,我们展示了LGM如何满足其中若干期望特性——这是此前无法实现的成就——同时也强调了当前系统中的重要局限性,这些局限性为新颖的ML研究开辟了机会。我们认为,仅凭LGM当前的能力实现准确、可靠且稳健的端到端发现系统具有挑战性。我们转而倡导防故障工具集成,以及通过反馈机制进行主动用户调节,以高效且可复现的方式促进数据驱动的科学发现。

英文摘要:

With the accumulation of data at an unprecedented rate, its potential to fuel scientific discovery is growing exponentially. This position paper urges the Machine Learning (ML) community to exploit the capabilities of large generative models (LGMs) to develop automated systems for end-to-end data-driven discovery -- a paradigm encompassing the search and verification of hypotheses purely from a set of provided datasets, without the need for additional data collection or physical experiments. We first outline several desiderata for an ideal data-driven discovery system. Then, through DATAVOYAGER, a proof-of-concept utilizing GPT-4, we demonstrate how LGMs fulfill several of these desiderata -- a feat previously unattainable -- while also highlighting important limitations in the current system that open up opportunities for novel ML research. We contend that achieving accurate, reliable, and robust end-to-end discovery systems solely through the current capabilities of LGMs is challenging. We instead advocate for fail-proof tool integration, along with active user moderation through feedback mechanisms, to foster data-driven scientific discoveries with efficiency and reproducibility.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑