Advancements in mobility services, navigation systems, and smart transportation technologies have made it possible to collect large amounts of path data. Modeling the distribution of this path data, known as the Path Generation (PG) problem, is crucial for understanding urban mobility patterns and developing intelligent transportation systems. Recent studies have explored using diffusion models to address the PG problem due to their ability to capture multimodal distributions and support conditional generation. A recent work devises a diffusion process explicitly in graph space and achieves state-of-the-art performance. However, this method suffers a high computation cost in terms of both time and memory, which prohibits its application. In this paper, we analyze this method both theoretically and experimentally and find that the main culprit of its high computation cost is its explicit design of the diffusion process in graph space. To improve efficiency, we devise a Latent-space Path Diffusion (LPD) model, which operates in latent space instead of graph space. Our LPD significantly reduces both time and memory costs by up to 82.8% and 83.1%, respectively. Despite these reductions, our approach does not suffer from performance degradation. It outperforms the state-of-the-art method in most scenarios by 24.5%~34.0%.
Improving the Euclidean Diffusion Generation of Manifold Data by Mitigating Score Function Singularity
Center for Data Science, Peking University(北京大学数据科学中心);Zuse Institute Berlin(柏林泽尼茨研究所);Center for Machine Learning Research, Peking University(北京大学机器学习研究中心);LMAM and School of Mathematical Sciences, Peking University(北京大学数学科学学院)
Understanding and Mitigating Memorization in Diffusion Models for Tabular Data
Department of Computer;Data Sciences, Case Western Reserve University, Cleveland, USA;Department of Computer Science \& Engineering, Texas A\&M University, College Station, USA;Department of Biochemistry, Case Western Reserve University, Cleveland, USA;Center for RNA Science;Therapeutics, Case Western Reserve University, Cleveland, USA;Department of Biomedical Engineering, Case Western Reserve University, Cleveland, USA
Mitigating Exposure Bias in Discriminator Guided Diffusion Models
Artificial Intelligence and Learning Systems Laboratory(人工智能与学习系统实验室);School of Electrical and Computer Engineering(电气与计算机工程学院);National Technical University of Athens(雅典国立技术大学)
Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability Landscapes
Department of Computer Science, Yonsei University, Seoul, Korea(计算机科学系,延世大学,首尔,韩国);Department of Artificial Intelligence, Yonsei University, Seoul, Korea(人工智能系,延世大学,首尔,韩国)
Mitigating Barren Plateaus in Quantum Denoising Diffusion Probabilistic Model
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算机科学与数据科学学院);Research Institute of Quantum Technology, The Hong Kong Polytechnic University(香港理工大学量子技术研究所)
A Stabilized Path-Space Approach to Diffusion-Based Posterior Sampling
Oden Institute for Computational Engineering and Sciences, The University of Texas at Austin(德克萨斯大学奥斯汀分校奥登计算工程与科学研究所);Mitsubishi Electric Research Laboratories (MERL)(三菱电机研究实验室);Department of Biomedical Engineering, The University of Texas at Austin(德克萨斯大学奥斯汀分校生物医学工程系);Mitsubishi Electric Research Laboratories(三菱电机研究实验室)
Mitigating Shortcut Learning with Diffusion Counterfactuals and Diverse Ensembles
Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Eberhard-Karls-Universität Tübingen(埃伯哈德卡尔斯蒂宾根大学);Idiap Research Institute(伊迪亚普研究所)