Generating realistic human-human interactions is a challenging task that requires not only high-quality individual body and hand motions, but also coherent coordination among all interactants. Due to limitations in available data and increased learning complexity, previous methods tend to ignore hand motions, limiting the realism and expressivity of the interactions. Additionally, current diffusion-based approaches generate entire motion sequences simultaneously, limiting their ability to capture the reactive and adaptive nature of human interactions. To address these limitations, we introduce Interact2Ar, the first end-to-end text-conditioned autoregressive diffusion model for generating full-body, human-human interactions. Interact2Ar incorporates detailed hand kinematics through dedicated parallel branches, enabling high-fidelity full-body generation. Furthermore, we introduce an autoregressive pipeline coupled with a novel memory technique that facilitates adaptation to the inherent variability of human interactions using efficient large context windows. The adaptability of our model enables a series of downstream applications, including temporal motion composition, real-time adaptation to disturbances, and extension beyond dyadic to multi-person scenarios. To validate the generated motions, we introduce a set of robust evaluators and extended metrics designed specifically for assessing full-body interactions. Through quantitative and qualitative experiments, we demonstrate the state-of-the-art performance of Interact2Ar.
DiffVC: A Non-autoregressive Framework Based on Diffusion Model for Video Captioning
School of Software, Northwestern Polytechnical University(西北工业大学软件学院);School of Computer Science, Northwestern Polytechnical University(西北工业大学计算机学院);Beijing University Of Technology(北京工业大学)
Epona: Autoregressive Diffusion World Model for Autonomous Driving
Horizon Robotics;Tsinghua University(清华大学);Peking University(北京大学);Nanjing University(南京大学);The Hong Kong University of Science and Technology(香港科学与技术大学);Nanyang Technological University(南洋理工大学);Tencent Hunyuan(腾讯文心)
Planning and Rendering in Concert: DeepFusion of Autoregressive Layouts and Diffusion for Visual Text Generation
University of Science and Technology of China(中国科学技术大学);Central South University(中南大学);Louisiana State University(路易斯安那州立大学);Arizona State University(亚利桑那州立大学);Sun Yat-sen University(中山大学)
MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space
Zhejiang University(浙江大学);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));The University of Hong Kong(香港大学);Shanghai Jiao Tong University(上海交通大学);DeepGlint;Shanghai AI Laboratory(上海人工智能实验室)
StreamingTalker: Audio-driven 3D Facial Animation with Autoregressive Diffusion Model
State Key Laboratory of CAD&CG, Zhejiang University(浙江大学计算机辅助设计与图形学国家重点实验室);Ant Group(蚂蚁集团);College of Computer Science, Zhejiang University(浙江大学计算机学院)
Block3D: Efficient Text-to-3D Generation via Block-Wise Diffusion
ZipLab, Zhejiang University(浙江大学ZipLab);University of California, Berkeley(加州大学伯克利分校);Wuhan University(武汉大学);Monash University(莫纳什大学);University of Adelaide(阿德莱德大学)
In-Context Forcing: Uncovering Context Effects in Autoregressive Video Diffusion
School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院);Tencent Youtu Lab(腾讯云图实验室);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models