This paper proposes a probabilistic motion prediction method for long motions. The motion is predicted so that it accomplishes a task from the initial state observed in the given image. While our method evaluates the task achievability by the Energy-Based Model (EBM), previous EBMs are not designed for evaluating the consistency between different domains (i.e., image and motion in our method). Our method seamlessly integrates the image and motion data into the image feature domain by spatially-aligned temporal encoding so that features are extracted along the motion trajectory projected onto the image. Furthermore, this paper also proposes a data-driven motion optimization method, Deep Motion Optimizer (DMO), that works with EBM for motion prediction. Different from previous gradient-based optimizers, our self-supervised DMO alleviates the difficulty of hyper-parameter tuning to avoid local minima. The effectiveness of the proposed method is demonstrated with a variety of experiments with similar SOTA methods.
Beyond Gaussian Bottlenecks: Topologically Aligned Encoding of Vision-Transformer Feature Spaces
Department of Computer Engineering, Koç University, Istanbul, Turkey(科克大学计算机工程系,伊斯坦布尔,土耳其);Department of Computer Engineering, Hacettepe University, Ankara, Turkey(哈恰塔佩大学计算机工程系,安卡拉,土耳其);KUIS AI Research Center, Istanbul, Turkey(KUIS人工智能研究中心,伊斯坦布尔,土耳其);Department of Electrical and Electronics Engineering, Koç University, Istanbul, Turkey(科克大学电气与电子工程系,伊斯坦布尔,土耳其)
ViBE: Visual-to-M/EEG Brain Encoding via Spatio-Temporal VAE and Distribution-Aligned Projection
Jinan University(济南大学);The First Affiliated Hospital of Jinan University(济南大学第一附属医院);Western University(西方大学);Guangdong University of Technology(广东工业大学);Tsinghua University(清华大学)
ViCoR: Reliable Molecular Structure Extraction via Spatially Aligned Verification and Executable Revision
The Hong Kong University of Science and Technology(香港科技大学);The Chinese University of Hong Kong(香港中文大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
Align-cDAE: Alzheimer's Disease Progression Modeling with Attention-Aligned Conditional Diffusion Auto-Encoder
Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India(电子工程系,印度理工学院马德拉斯,钦奈,印度);Sudha Gopalakrishnan Brain Centre, Indian Institute of Technology Madras, Chennai, India(苏达·戈帕拉克里希南脑中心,印度理工学院马德拉斯,钦奈,印度);Department of Electrical Engineering, Indian Institute of Technology Madras Chennai, India(电子工程系,印度理工学院马德拉斯钦奈,印度)
Rethinking the Encoding and Annotating of 3D Bounding Box: Corner-Aware 3D Object Detection from Point Clouds
School of Computer Science, Beijing Institute of Technology(计算机科学学院,北京理工大学);Computer Science Program, Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division, Center of Excellence for Smart Health, and Center of Excellence for Generative AI, King Abdullah University of Science and Technology (KAUST)(计算机科学项目,计算机、电气和数学科学与工程(CEMSE)部门,智能健康卓越中心,生成人工智能卓越中心,国王阿卜杜勒·阿齐兹大学科学与技术(KAUST));State Key Laboratory of Internet of Things for Smart City, Department of Computer and Information Science, University of Macau(智慧城市物联网国家重点实验室,澳门大学计算机与信息科学系);Guangdong Provincial Key Laboratory of Machine Perception and Intelligent Computing, Shenzhen MSU-BIT University(广东省机器感知与智能计算重点实验室,深圳MSU-BIT大学);Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science, Beijing Institute of Technology(北京智能信息技术重点实验室,计算机科学学院,北京理工大学)
Discrete Diffusion Bridges for Spatiotemporally Aligned Image Translation and Generation
Shenyang Institute of Automation, Chinese Academy of Sciences(中国科学院沈阳自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);The University of Hong Kong(香港大学);School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院)
A 2D Semantic-Aware Position Encoding for Vision Transformers
Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University, Shanghai, China(上海数据科学 key laboratory,计算机科学学院,复旦大学,上海,中国);Alibaba Group, Shanghai, China(阿里巴巴集团,上海,中国);Department of Physics, Fudan University, Shanghai, China(物理系,复旦大学,上海,中国)
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
University of Southern California(南加州大学);USC Institute for Creative Technologies(南加州大学创意技术研究所);Waseda University(早稻田大学);University of California, Berkeley(加州大学伯克利分校);Pinscreen