While machine learning models are typically trained to solve prediction problems, we might often want to use them for optimization problems. For example, given a dataset of proteins and their corresponding fluorescence levels, we might want to optimize for a new protein with the highest possible fluorescence. This kind of data-driven optimization (DDO) presents a range of challenges beyond those in standard prediction problems, since we need models that successfully predict the performance of new designs that are better than the best designs seen in the training set. It is not clear theoretically when existing approaches can even perform better than the naive approach that simply selects the best design in the dataset. In this paper, we study how structure can enable sample-efficient data-driven optimization. To formalize the notion of structure, we introduce functional graphical models (FGMs) and show theoretically how they can provide for principled data-driven optimization by decomposing the original high-dimensional optimization problem into smaller sub-problems. This allows us to derive much more practical regret bounds for DDO, and the result implies that DDO with FGMs can achieve nearly optimal designs in situations where naive approaches fail due to insufficient coverage of the offline data. We further present a data-driven optimization algorithm that inferes the FGM structure itself, either over the original input variables or a latent variable representation of the inputs.
Thresholded Graphical Lasso Adjusts for Latent Variables: Application to Functional Neural Connectivity
Rice University(莱斯大学);Baylor College of Medicine(贝勒医学院)
在神经科学中,研究人员试图从大规模的神经记录或成像中揭示神经元的连通性;人们经常使用图形模型选择和估计技术来实现这一目的。但是,现有的技术只能记录一小部分神经元,这导致了在存在大量潜在变量的情况下图选择的挑战性问题。Anglasekaran et al.(2012)提出了一个凸规划来解决这个问题,从计算和统计的角度提出了挑战。为了解决这个问题,我们提出了一个非常简单的解决方案:将硬阈值算子应用于现有的图选择方法。概念上简单,计算上有吸引力,我们证明,阈值的图形套索,邻域选择,或CLIME估计具有优越的理论特性,在图形选择的一致性,以及更强的实证结果比现有的方法的潜在变量图形模型问题。我们还证明了我们的方法的适用性,通过神经科学案例研究钙成像数据来估计功能性神经连接。
High-dimensional Functional Graphical Model Structure Learning via Neighborhood Selection Approach
Booth School of Business, The University of Chicago(芝加哥大学布斯商学院);Department of Statistics and Data Science, Cornell University(康奈尔大学统计与数据科学系);Department of Data Sciences and Operations, Marshall School of Business, University of Southern California(南加州大学马歇尔商学院数据科学与运营系)
FuDGE: A Method to Estimate a Functional Differential Graph in a High-Dimensional Setting
Booth School of Business(布斯商学院);The University of Chicago(芝加哥大学);Cornell University(康奈尔大学)
We consider the problem of estimating the difference between two undirected functional graphical models with shared structures. In many applications, data are naturally regarded as a vector of random functions rather than as a vector of scalars. For example, electroencephalography (EEG) data are treated more appropriately as functions of time. In such a problem, not only can the number of functions measured per sample be large, but each function is itself an infinite-dimensional object, making estimation of model parameters challenging. This is further complicated by the fact that curves are u…
Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots
Computing and Mathematical Sciences, California Institute of Technology, Pasadena, CA 91125, USA(计算与数学科学系,加州理工学院,帕萨迪纳,CA 91125,美国);Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA 91109, USA(喷气推进实验室,加州理工学院,帕萨迪纳,CA 91109,美国)
Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning
Columbia University(哥伦比亚大学);Northwestern University(西北大学);Yale University(耶鲁大学);University of Michigan(密歇根大学);University of Washington(华盛顿大学);University of Southern California(南加州大学)
PyCFRL: A Python library for counterfactually fair offline reinforcement learning via sequential data preprocessing
Department of Statistics, University of Michigan, USA(统计学系,密歇根大学);Department of Biostatistics, University of Michigan, USA(生物统计学系,密歇根大学);Department of Statistics, London School of Economics, UK(统计学系,伦敦经济学院);Department of Health Behavior and Health Equity, School of Public Health, University of Michigan, USA(健康行为与健康公平系,公共卫生学院,密歇根大学)