We present a novel offline-online method to mitigate the computational burden of the characterization of posterior random variables in statistical learning. In the offline phase, the proposed method learns the joint law of the parameter random variables and the observable random variables in the tensor-train (TT) format. In the online phase, the resulting order-preserving conditional transport can characterize the posterior random variables given newly observed data in real time. Compared with the state-of-the-art normalizing flow techniques, the proposed method relies on function approximation and is equipped with a thorough performance analysis. The function approximation perspective also allows us to further extend the capability of transport maps in challenging problems with high-dimensional observations and high-dimensional parameters. On the one hand, we present novel heuristics to reorder and/or reparametrize the variables to enhance the approximation power of TT. On the other hand, we integrate the TT-based transport maps and the parameter reordering/reparametrization into layered compositions to further improve the performance of the resulting transport maps. We demonstrate the efficiency of the proposed method on various statistical learning tasks in ordinary differential equations (ODEs) and partial differential equations (PDEs).
Scalable Logistic Gaussian Process Density Regression with Kinetic Langevin Sampling
Nanyang Technological University(南洋理工大学);Eötvös Loránd University (ELTE)(厄特沃什·罗兰大学(ELTE));HUN-REN Institute for Computer Science and Control (SZTAKI)(匈牙利国家研究网络计算机科学与控制研究所(SZTAKI))
An Efficient Conditional Score-based Filter for High Dimensional Nonlinear Filtering Problems
Department of Mathematical Sciences, Tsinghua University(清华大学数学科学系);Yau Mathematical Sciences Center, Tsinghua University(清华大学叶中伟数学科学中心);Yanqi Lake Beijing Institute of Mathematical Sciences and Applications(北京燕琦湖数学科学与应用研究所)
DISCO: Mitigating Bias in Deep Learning with Conditional Distance Correlation
Technical University of Munich, Germany(慕尼黑技术大学);Konrad Zuse School of Excellence in Reliable AI, Germany(Konrad Zuse可靠性人工智能卓越学院);Munich Center for Machine Learning (MCML), Germany(慕尼黑机器学习中心(MCML))
Conditional Vendi Score: Prompt-Aware Diversity Evaluation for Generative AI Models and LLMs
Department of Computer Science and Engineering, The Chinese University of Hong Kong(计算机科学与工程系,香港中文大学);Department of Information Engineering, The Chinese University of Hong Kong(信息工程系,香港中文大学)
针对文本提示引导的生成模型,提出条件 Vendi 和条件 RKE 分数,通过条件熵分离模型自身多样性,并证明收敛性及在多个任务中恢复真实多样性排序。
SPARKE: Scalable Prompt-Aware Diversity and Novelty Guidance in Diffusion Models via RKE Score
Department of Computer Science and Engineering, The Chinese University of Hong Kong(计算机科学与工程系,香港中文大学);Department of Information Engineering, The Chinese University of Hong Kong(信息工程系,香港中文大学)
Parallel Complex Diffusion for Scalable Time Series Generation
Institute of Cyber-Systems and Control(网络系统与控制研究所);Zhejiang University(浙江大学);Griffith University(格里菲斯大学);School of Mathematics(数学学院);Southeast University(东南大学);Squirrel Ai Learning
Fast and Scalable Score-Based Kernel Calibration Tests
Gatsby Computational Neuroscience Unit(加布特计算神经科学单位);University College London(伦敦大学学院);Department of Information Technology(信息技术系);Uppsala University(乌普萨拉大学);Division of Statistics and Machine Learning(统计与机器学习 division);Linköping University(林雪平大学)
Scalable Causal Discovery from Recursive Nonlinear Data via Truncated Basis Function Scores and Tests
Department of Philosophy(哲学系);Carnegie Mellon University(卡内基梅隆大学);Department of Psychiatry & Behavioral Sciences(精神病学与行为科学系);University of Minnesota(明尼苏达大学)