Human cognition has compositionality. We understand a scene by decomposing the scene into different concepts (e.g., shape and position of an object) and learning the respective laws of these concepts, which may be either natural (e.g., laws of motion) or man-made (e.g., laws of a game). The automatic parsing of these laws indicates the model's ability to understand the scene, which makes law parsing play a central role in many visual tasks. This paper proposes a deep latent variable model for Compositional LAw Parsing (CLAP), which achieves the human-like compositionality ability through an encoding-decoding architecture to represent concepts in the scene as latent variables. CLAP employs concept-specific latent random functions instantiated with Neural Processes to capture the law of concepts. Our experimental results demonstrate that CLAP outperforms the baseline methods in multiple visual tasks such as intuitive physics, abstract visual reasoning, and scene representation. The law manipulation experiments illustrate CLAP's interpretability by modifying specific latent random functions on samples. For example, CLAP learns the laws of position-changing and appearance constancy from the moving balls in a scene, making it possible to exchange laws between samples or compose existing laws into novel laws.
Exploring Compositional Visual Generation with Latent Classifier Guidance
University of California, San Diego（加州大学圣地亚哥分校）；The Pennsylvania State University（宾夕法尼亚州立大学）；NEC Laboratories America（NEC美国实验室）；Northwestern University（西北大学）
Compositional Cross-Modality Translation via Whole-Volume Multitask Latent Flow Matching
Università Campus Bio-Medico di Roma（罗马 Campus Bio-Medico 大学）；Umeå University（于默奥大学）；UniCamillus – Saint Camillus International University of Health Sciences（UniCamillus – 圣卡米勒斯国际健康科学大学）
The Pictorial Cortex: Zero-Shot Cross-Subject fMRI-to-Image Reconstruction via Compositional Latent Modeling
Institute of Science and Technology for Brain-inspired Intelligence (ISTBI), Fudan University（脑启发智能科学与技术研究院，复旦大学）；School of Data Science, Fudan University（复旦大学数据科学学院）；Fudan ISTBI–ZJNU Algorithm Centre for Brain-Inspired Intelligence, Zhejiang Normal University（复旦ISTBI-浙师大脑启发智能算法中心，浙江师范大学）；Shanghai Innovation Institute（上海创新研究院）；Nanyang Technological University（南洋理工大学）
SceneTransporter: Optimal Transport-Guided Compositional Latent Diffusion for Single-Image Structured 3D Scene Generation
Xi’an Research Institute of Hi-Tech（西安高新技术研究院）；Tsinghua University（清华大学）；SkyWork AI；Tongji University（同济大学）；Fudan University（复旦大学）；Beijing Normal University（北京师范大学）
MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation
Academy for Engineering and Technology（工程与技术学院）；Cognition and Intelligent Technology Laboratory (CIT Lab)（认知与智能技术实验室）；School of Future Science and Engineering（未来科学与工程学院）；Jilin Provincial Key Laboratory of Intelligence Science and Engineering（吉林省智能科学与工程重点实验室）；Engineering Research Center of AI and Robotics, Ministry of Education（人工智能与机器人工程研究中心）
Compositional Factorization of Visual Scenes with Convolutional Sparse Coding and Resonator Networks
Redwood Center for Theoretical Neuroscience, UC Berkeley（加州大学伯克利分校红木理论神经科学中心）；Université Paris-Saclay（巴黎-萨克雷大学）；Örebro University（厄勒布鲁大学）；Research Institutes of Sweden（瑞典研究院）
Predicting Scene Parsing and Motion Dynamics in the Future
NUS Graduate School for Integrative Science and Engineering (NGS), NUS（新加坡国立大学综合科学与工程研究生院）；Department of ECE, NUS（新加坡国立大学电子与计算机工程系）；Adobe Research（Adobe 研究院）；Tencent AI Lab（腾讯人工智能实验室）；Qihoo 360 AI Institute（奇虎360人工智能研究院）
