Recent advancements in the realm of deep learning, particularly in the development of large language models (LLMs), have demonstrated AI's ability to tackle complex mathematical problems or solving programming challenges. However, the capability to solve well-defined problems based on extensive training data differs significantly from the nuanced process of making scientific discoveries. Trained on almost all human knowledge available, today's sophisticated LLMs basically learn to predict sequences of tokens. They generate mathematical derivations and write code in a similar way as writing an essay, and do not have the ability to pioneer scientific discoveries in the manner a human scientist would do.
In this study we delve into the potential of using deep learning to rediscover a fundamental mathematical concept: integrals. By defining integrals as area under the curve, we illustrate how AI can deduce the integral of a given function, exemplified by inferring $\int_{0}^{x} t^2 dt = \frac{x^3}{3}$ and $\int_{0}^{x} ae^{bt} dt = \frac{a}{b} e^{bx} - \frac{a}{b}$. Our experiments show that deep learning models can approach the task of inferring integrals either through a sequence-to-sequence model, akin to language translation, or by uncovering the rudimentary principles of integration, such as $\int_{0}^{x} t^n dt = \frac{x^{n+1}}{n+1}$.
Automated Algorithmic Discovery for Scientific Computing through LLM-Guided Evolutionary Search: A Case Study in Gravitational-Wave Detection
International Centre for Theoretical Physics Asia-Pacific(国际理论物理中心亚太中心);University of Chinese Academy of Sciences(中国科学院大学);Taiji Laboratory for Gravitational Wave Universe(引力波宇宙Taiji实验室);Tsinghua University(清华大学)
QLPro: Automated Code Vulnerability Discovery via LLM and Static Code Analysis Integration
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院)
Towards Automated Error Discovery: A Study in Conversational AI
Ubiquitous Knowledge Processing Lab (UKP Lab), Department of Computer Science and Hessian Center for AI (hessian.AI), Technical University of Darmstadt(德累斯顿技术大学)
CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent Simulations
College of Intelligence and Computing, Tianjin University(天津大学智能计算学院);Tianjin Key Laboratory of Healthy Habitat and Smart Technology(天津健康人居环境与智能技术重点实验室);Laboratory of Computation and Analytics of Complex Management Systems, Tianjin University(复杂管理系统计算与分析实验室)
Beyond Static Rules: Automated Discovery of Latent Vulnerabilities in Text-to-SQL
Shanghai University of Finance and Economics(上海财经大学);Beihang University(北京航空航天大学);Deepexi Technology Co. Ltd.(深圳市智元机器有限公司);Southern University of Science and Technology(南方科技大学)
Automated discovery of symbolic laws governing skill acquisition from naturally occurring data
National Engineering Research Center of Educational Big Data, Central China Normal University(华中师范大学教育大数据国家工程研究中心);Faculty of Artificial Intelligence in Education, Central China Normal University(华中师范大学人工智能教育学部);National Engineering Research Center for E-learning, Central China Normal University(华中师范大学国家数字化学习工程技术研究中心)
AutoSciDACT: Automated Scientific Discovery through Contrastive Embedding and Hypothesis Testing
Department of Physics, Massachusetts Institute of Technology(麻省理工学院物理系);The NSF AI Institute for Artificial Intelligence and Fundamental Interactions(国家科学基金会人工智能与基本相互作用研究所);Department of Physics, University of Wisconsin, Madison(威斯康星大学麦迪逊分校物理系)
On the Hybrid Nature of ABPMS Process Frames and its Implications on Automated Process Discovery
University of Tartu(塔尔图大学);Free University of Bozen-Bolzano(博兹纳-博尔扎诺自由大学);Bar-Ilan University(巴伊兰大学);Technion – Israel Institute of Technology(技术学院-以色列理工学院)
Solving with GeoGebra Discovery an Austrian Mathematics Olympiad problem: Lessons Learned
Universidad Rey Juan Carlos(胡安·卡洛斯国王大学);The Private University College of Education of the Diocese of Linz(林茨教区私立教育学院);Universidad Antonio de Nebrija(安东尼奥·德·内布里哈大学)
Accelerating Medical Knowledge Discovery through Automated Knowledge Graph Generation and Enrichment
TIB – Leibniz Information Centre for Science and Technology(TIB——莱布尼茨科学与技术信息中心);Harvard University(哈佛大学);University of Birmingham(伯明翰大学);Amazon(亚马逊公司);St. John’s University(圣约翰大学)