University of Campinas(坎皮纳斯大学);Leuphana University(勒芬那大学);Norwegian University of Science and Technology(挪威科技大学)
Samuel G. Fadel, Sebastian Mair, Ricardo da S. Torres, Ulf Brefeld
备注:
20 pages, 11 figures, accepted at the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD 2021)
Generative models based on normalizing flows are very successful in modeling complex data distributions using simpler ones. However, straightforward linear interpolations show unexpected side effects, as interpolation paths lie outside the area where samples are observed. This is caused by the standard choice of Gaussian base distributions and can be seen in the norms of the interpolated samples as they are outside the data manifold. This observation suggests that changing the way of interpolating should generally result in better interpolations, but it is not clear how to do that in an unambiguous way. In this paper, we solve this issue by enforcing a specific manifold and, hence, change the base distribution, to allow for a principled way of interpolation. Specifically, we use the Dirichlet and von Mises-Fisher base distributions on the probability simplex and the hypersphere, respectively. Our experimental results show superior performance in terms of bits per dimension, Fréchet Inception Distance (FID), and Kernel Inception Distance (KID) scores for interpolation, while maintaining the generative performance.
Fractal Flow: Hierarchical and Interpretable Normalizing Flow via Topic Modeling and Recursive Strategy
School of Mathematics Harbin Institute of Technology(哈尔滨工业大学数学学院);School of Mathematics and Institute for Artificial Intelligence Harbin Instiute of Technology(哈尔滨工业大学数学学院和人工智能研究院);School of Earth and Space Sciences and Institute for Artificial Intelligence Peking University(北京大学地球和空间科学学院和人工智能研究院)
Anomaly detection in time-series via inductive biases in the latent space of conditional normalizing flows
Department of Computer Science Norwegian University of Science and Technology(挪威科学技术大学计算机科学系);BCAM – Basque Center for Applied Mathematics University of Coimbra, CISUC/LASI, DEI(巴斯克应用数学中心,科英布拉大学,CISUC/LASI,DEI);IKERBASQUE — Basque Foundation for Science(巴斯克科学基金会)
SetupKit: Efficient Multi-Corner Setup/Hold Time Characterization Using Bias-Enhanced Interpolation and Active Learning
University of California, Los Angeles, United States(美国加州大学洛杉矶分校);Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo, China(宁波数字孪生研究所);BTD Inc, Ningbo, China(中国宁波BTD公司);The University of Sheffield, Sheffield, United Kingdom(英国谢菲尔德大学)
Chalmers University of Technology and University of Gothenburg, Dept. Computer Science and Engineering(查尔姆斯理工大学和哥德堡大学,计算机科学与工程系);Massachusetts Institute of Technology, Research Laboratory of Electronics(麻省理工学院,电子研究实验室);Technical University of Munich(慕尼黑技术大学);Helmholtz AI, Munich(海德堡人工智能研究所,慕尼黑);Max Planck Institute for Intelligent Systems, Tübingen(马克斯·普朗克智能系统研究所,图宾根)
GenPANIS: A Latent-Variable Generative Framework for Forward and Inverse PDE Problems in Multiphase Media
Technical University of Munich, Professorship of Data-driven Materials Modeling, School of Engineering and Design(慕尼黑技术大学,数据驱动材料建模教授职位,工程与设计学院);Munich Data Science Institute (MDSI - Core member)(慕尼黑数据科学研究所(MDSI—核心成员))
Booth School of Business, University of Chicago(芝加哥大学布斯商学院);Department of Statistics, University of Michigan(密歇根大学统计系);Department of Mathematics, University of Maryland, College Park(马里兰大学帕克分校数学系)
Scale-Adaptive Generative Flows for Multiscale Scientific Data
Department of Mathematics, University of California, Los Angeles(加州大学洛杉矶分校数学系);Machine Learning Lab, Capital Fund Management(资本基金管理有限公司机器学习实验室);Courant Institute, New York University(纽约大学柯朗研究所)
SplineFlow: Flow Matching for Dynamical Systems with B-Spline Interpolants
CISPA Helmholtz Center for Information Security(CISPA海德堡信息安全研究中心);Department of Computer Science and Technology(计算机科学与技术系);University of Cambridge(剑桥大学)
Probing the Geometry of Diffusion Models with the String Method
Capital Fund Management(资本基金管理公司);ML Lab, Capital Fund Management(机器学习实验室,资本基金管理公司);Courant Institute of Mathematical Sciences, New York University(Courant数学科学研究所,纽约大学)
Riemannian AmbientFlow: Towards Simultaneous Manifold Learning and Generative Modeling from Corrupted Data
Department of Mathematics, University of California, Los Angeles(数学系,加州大学洛杉矶分校);Department of Statistics and Data Science, University of California, Los Angeles(统计与数据科学系,加州大学洛杉矶分校)
Mathematical Institute, University of Oxford(牛津大学数学研究所);Oxford-Man Institute, University of Oxford(牛津大学奥克斯曼研究所);OATML, Department of Computer Science, University of Oxford(牛津大学计算机科学系OATML);Department of Engineering, University of Cambridge(剑桥大学工程系)
Faster Diffusion Models via Higher-Order Approximation
Department of Statistics, Chinese University of Hong Kong(香港中文大学统计学系);Department of Statistics, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校统计学系);Department of Statistics and Data Science, the Wharton School, University of Pennsylvania(宾夕法尼亚大学沃顿商学院统计学与数据科学系)
Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions
The Oskar Klein Centre, Department of Physics, Stockholm University, AlbaNova University Centre(奥斯卡·克莱因中心,物理系,斯德哥尔摩大学,阿尔瓦纳大学中心);Center for Computational Astrophysics, Flatiron Institute(计算天体物理学中心,Flatiron研究所)
What's Inside Your Diffusion Model? A Score-Based Riemannian Metric to Explore the Data Manifold
Institut de la Vision & Laboratoire des Systèmes Perceptifs(视觉研究所及感知系统实验室);Sorbonne Université & École Normale Supérieure(索邦大学及巴黎高等师范学院);Group for Neural Theory(神经理论小组);École Normale Supérieure(巴黎高等师范学院)
Lipschitz-Guided Design of Interpolation Schedules in Generative Models
Department of Mathematics, University of California, Los Angeles, CA, USA(加州大学洛杉矶分校数学系);Machine Learning Lab, Capital Fund Management, Paris, France(Capital Fund Management机器学习实验室);Courant Institute, New York University, NY, USA(纽约大学Courant研究所);Now at University of Maryland, College Park, MD, USA(现在位于马里兰大学 College Park 分校)