AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoising
Zhejiang University(浙江大学);Beijing University of Posts and Telecommunications(北京邮电大学);Kling Team, Kuaishou Technology(快手科技 Kling 团队);Tsinghua University(清华大学)
Liyuan Cui, Wentao Hu, Wenyuan Zhang, Zesong Yang, Fan Shi, Xiaoqiang Liu
Real-time talking avatar generation requires low latency and minute-level temporal stability. Autoregressive (AR) forcing enables streaming inference but suffers from exposure bias, which causes errors to accumulate and become irreversible over long rollouts. In contrast, full-sequence diffusion transformers mitigate drift but remain computationally prohibitive for real-time long-form synthesis. We present AvatarForcing, a one-step streaming diffusion framework that denoises a fixed local-future window with heterogeneous noise levels and emits one clean block per step under constant per-step cost. To stabilize unbounded streams, the method introduces dual-anchor temporal forcing: a style anchor that re-indexes RoPE to maintain a fixed relative position with respect to the active window and applies anchor-audio zero-padding, and a temporal anchor that reuses recently emitted clean blocks to ensure smooth transitions. Real-time one-step inference is enabled by two-stage streaming distillation with offline ODE backfill and distribution matching. Experiments on standard benchmarks and a new 400-video long-form benchmark show strong visual quality and lip synchronization at 34 ms/frame using a 1.3B-parameter student model for realtime streaming. Our page is available at: https://cuiliyuan121.github.io/AvatarForcing/
The Hong Kong Polytechnic University(香港理工大学);Center for Artificial Intelligence and Robotics, HKISI CAS(中国科学院香港创新研究院人工智能与机器人创新中心);State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA(中国科学院自动化研究所多模态人工智能系统全国重点实验室);OPPO Research(OPPO研究院)
Controllability, generalizability and efficiency are the major objectives of constructing face avatars represented by neural implicit field. However, existing methods have not managed to accommodate the three requirements simultaneously. They either focus on static portraits, restricting the representation ability to a specific subject, or suffer from substantial computational cost, limiting their flexibility. In this paper, we propose One-shot Talking face Avatar (OTAvatar), which constructs face avatars by a generalized controllable tri-plane rendering solution so that each personalized avat…
VedicTHG: Symbolic Vedic Computation for Low-Resource Talking-Head Generation in Educational Avatars
Engineering Sciences, Homi Bhabha National Institute Training School Complex(工程科学,霍米·巴哈瓦国家研究所培训学校复杂区);Computer and Informatics Group, Variable Energy Cyclotron Centre(计算机与信息组,变能回旋加速器中心)
TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation
MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS部);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Meituan(美团);The Hong Kong Polytechnic University(香港理工大学);CAIR, HKISI, CAS(中国科学院CAS HKISI CAIR)
GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting
PCA Lab, Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院,教育部高维信息智能感知与系统重点实验室,PCA实验室);Tsientang Institute for Advanced Study(浙江大学前沿交叉研究院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
DEGAS: Detailed Expressions on Full-Body Gaussian Avatars
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Prometheus Vision Technology Co., Ltd.(天视智能科技有限公司);The Hong Kong University of Science and Technology(香港科技大学);Swinburne University of Technology(斯威本科技大学)
SyncAnimation: A Real-Time End-to-End Framework for Audio-Driven Human Pose and Talking Head Animation
AiShiWeiLai AI Research(AiShiWeiLai AI研究院);South China University of Technology(华南理工大学);Beijing Institute of Technology(北京理工大学);Beijing University of Posts and Telecommunications(北京邮电大学)
EmbodiedHead: Real-Time Listening and Speaking Avatar for Conversational Agents
School of Computer Science and Technology, East China Normal University, Shanghai, China(东华大学计算机科学与技术学院,上海,中国);Garabido Shanghai Technology Co., Ltd., Shanghai, China(Garabido上海科技有限公司,上海,中国)
ALIVE: An Avatar-Lecture Interactive Video Engine with Content-Aware Retrieval for Real-Time Interaction
Department of Computer Science Rensselaer Polytechnic Institute(计算机科学系罗切斯特理工学院);Department of Biomedical Engineering Rensselaer Polytechnic Institute(生物医学工程系罗切斯特理工学院)
Over the last few decades, many aspects of human life have been enhanced with virtual domains, from the advent of digital assistants such as Amazon's Alexa and Apple's Siri to the latest metaverse efforts of the rebranded Meta. These trends underscore the importance of generating photorealistic visual depictions of humans. This has led to the rapid growth of so-called deepfake and talking-head generation methods in recent years. Despite their impressive results and popularity, they usually lack certain qualitative aspects such as texture quality, lips synchronization, or resolution, and practi…