This paper addresses new methodologies to deal with the challenging task of generating dynamic Human-Object Interactions from textual descriptions (Text2HOI). While most existing works assume interactions with limited body parts or static objects, our task involves addressing the variation in human motion, the diversity of object shapes, and the semantic vagueness of object motion simultaneously. To tackle this, we propose a novel Text-guided Human-Object Interaction diffusion model with Relation Intervention (THOR). THOR is a cohesive diffusion model equipped with a relation intervention mechanism. In each diffusion step, we initiate text-guided human and object motion and then leverage human-object relations to intervene in object motion. This intervention enhances the spatial-temporal relations between humans and objects, with human-centric interaction representation providing additional guidance for synthesizing consistent motion from text. To achieve more reasonable and realistic results, interaction losses is introduced at different levels of motion granularity. Moreover, we construct Text-BEHAVE, a Text2HOI dataset that seamlessly integrates textual descriptions with the currently largest publicly available 3D HOI dataset. Both quantitative and qualitative experiments demonstrate the effectiveness of our proposed model.
Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymization
School of Computer Science and Engineering, South China University of Technology(华南理工大学计算机科学与工程学院);School of Future Technology, South China University of Technology(华南理工大学未来技术学院);School of Computing and Information Systems, Singapore Management University(新加坡管理学院计算机与信息学院)
Lung-DDPM+: Efficient Thoracic CT Image Synthesis using Diffusion Probabilistic Model
Centre de recherche du CHU de Québec-Université Laval(魁北克-拉瓦尔大学研究中心);Department of Molecular Biology, Medical Biochemistry and Pathology, Université Laval(拉瓦尔大学分子生物学、医学生物化学与病理学系);Cancer Research Center, Université Laval(拉瓦尔大学癌症研究中心);Big Data Research Center, Université Laval(拉瓦尔大学大数据研究中心);Department of Radiology, Carver College of Medicine - The University of Iowa(爱荷华大学卡弗医学院放射科)
A Diffusion Model for Simulation Ready Coronary Anatomy with Morpho-skeletal Control
Institute of Medical Engineering, MIT(麻省理工学院医学工程研究所);Brigham and Women's Hospital, Harvard(哈佛大学布莱尔妇女医院);HeartFlow(HeartFlow公司);Showa University(昭和大学);OLV Aalst
SafeCtrl: Region-Aware Safety Control for Text-to-Image Diffusion via Detect-Then-Suppress
School of Computer Science and Technology, Fudan University(复旦大学计算机科学技术学院);Institute of Big Data, Fudan University(复旦大学大数据研究院);Nanjing University of Information Science and Technology(南京信息工程大学)
Lung-DDPM: Semantic Layout-guided Diffusion Models for Thoracic CT Image Synthesis
Centre de recherche du CHU de Québec-Université Laval(魁北克大学拉瓦尔医院研究中心);Centre de recherche de l’Institut universitaire de cardiologie et de pneumologie de Québec-Université Laval(魁北克大学拉瓦尔心血管与呼吸病学研究所)
CleanVideo: Adaptive Concept Erasure for Text-to-Video Diffusion Models
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学);University of Electronic Science and Technology of China (UESTC)(电子科技大学);The Hong Kong University of Science and Technology (HKUST)(香港科技大学)
Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models
Fudan University(复旦大学);Shanghai Key Lab of Intell. Info. Processing(上海智能信息处理重点实验室);School of Computer Science(计算机学院);Shanghai Collaborative Innovation Center on Intelligent Visual Computing(上海智能视觉计算协同创新中心)
T2ID-CAS: Diffusion Model and Class Aware Sampling to Mitigate Class Imbalance in Neck Ultrasound Anatomical Landmark Detection
Department of Computer Science, University of Central Florida(计算机科学系,中央佛罗里达大学);Department of Otolaryngology Head Neck Surgery, University of Cincinnati College of Medicine(耳鼻喉科与头颈外科系,辛辛那提大学医学院);Department of Internal Medicine, University of Central Florida College of Medicine(内科系,中央佛罗里达大学医学院)
MD-Dose: A diffusion model based on the Mamba for radiation dose prediction
Chengdu Institute of Computer Application, Chinese Academy of Sciences(中国科学院成都计算机应用研究所);School of Computer Science and Technology, University of Chinese Academy of Sciences(中国科学院大学计算机科学与技术学院);Sichuan University West China Hospital(四川大学华西医院);Radiophysical Technology Center, Cancer Center, West China Hospital, Sichuan University(四川大学华西医院肿瘤中心放射物理技术中心)