Dynamic Bayesian networks provide a compact and natural representation for complex dynamic systems. However, in many cases, there is no expert available from whom a model can be elicited. Learning provides an alternative approach for constructing models of dynamic systems. In this paper, we address some of the crucial computational aspects of learning the structure of dynamic systems, particularly those where some relevant variables are partially observed or even entirely unknown. Our approach is based on the Structural Expectation Maximization (SEM) algorithm. The main computational cost of the SEM algorithm is the gathering of expected sufficient statistics. We propose a novel approximation scheme that allows these sufficient statistics to be computed efficiently. We also investigate the fundamental problem of discovering the existence of hidden variables without exhaustive and expensive search. Our approach is based on the observation that, in dynamic systems, ignoring a hidden variable typically results in a violation of the Markov property. Thus, our algorithm searches for such violations in the data, and introduces hidden variables to explain them. We provide empirical results showing that the algorithm is able to learn the dynamics of complex systems in a computationally tractable way.
Scientifically-Interpretable Reasoning Network (ScIReN): Discovering Hidden Relationships in the Carbon Cycle and Beyond
Department of Informatics and Intelligent Systems, Institute of Energy and the Environment, The Pennsylvania State University(信息学与智能系统系,能源与环境研究所,宾夕法尼亚州立大学)
Discovering and Reasoning of Causality in the Hidden World with Large Language Models
TMLR Group, Hong Kong Baptist University(香港 Baptist 大学 TMLR 组);Mohamed bin Zayed University of Artificial Intelligence(Mohamed bin Zayed 人工智能大学);Department of Philosophy, Carnegie Mellon University(哲学系,卡内基梅隆大学);School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);School of Mathematics and Statistics, The University of Melbourne(墨尔本大学数学与统计学学院);The Chinese University of Hong Kong(香港中文大学)
Hidden APIs in Language Models: Discovering Reusable Causal Interfaces from Forked Futures
Nanyang Technological University(南洋理工大学);Southern University of Science and Technology(南方科技大学);Tianjin University(天津大学);Sun Yat-sen University(中山大学);Carnegie Mellon University(卡内基梅隆大学);Georgia Institute of Technology(佐治亚理工学院);The Hong Kong Polytechnic University(香港理工大学);Shenzhen University(深圳大学);Tsinghua University(清华大学);The Hong Kong University of Science and Technology(香港科技大学)
Discovering heuristics in a complex SAT solver with large language models
School of Data Science, Fudan University, Shanghai, China(复旦大学数据科学学院,上海,中国);Key Laboratory of System Software, Institute of Software, Chinese Academy of Sciences, Beijing, China(中国科学院软件研究所系统软件重点实验室,北京,中国);SeedMath Technology Limited, Beijing, China(SeedMath技术有限公司,北京,中国)
A Data-Driven Framework for Discovering Fractional Differential Equations in Complex Systems
Ningbo Key Laboratory of Advanced Manufacturing Simulation, Eastern Institute of Technology, Ningbo, Zhejiang 315200, China(宁波先进制造模拟重点实验室,东部技术学院,宁波,浙江 315200,中国);Department of Electronic Engineer and Information Science, University of Science and Technology of China, Hefei, Anhui, 230026, China(电子工程与信息科学系,中国科学技术大学,合肥,安徽 230026,中国);School of Mathematical Sciences, Eastern Institute of Technology-Ningbo, China(数学科学学院,东部技术学院-宁波,中国);Institute of Hydraulics and Fluid Mechanics, Hohai University, Nanjing 211100, China(水利与流体机械研究院,河海大学,南京 211100,中国);Department of Geological Sciences, University of Alabama, Tuscaloosa, AL, USA(地质科学系,阿拉巴马大学,塔斯卡洛萨,AL,美国);Zhejiang Key Laboratory of Industrial Intelligence and Digital Twin, Eastern Institute of Technology, Ningbo, Zhejiang 315200, China(浙江工业智能与数字孪生重点实验室,东部技术学院,宁波,浙江 315200,中国)