Traditional methods for visualizing dynamic human expressions, particularly in medical training, often rely on flat-screen displays or static mannequins, which have proven inefficient for realistic simulation. In response, we propose a platform that leverages a 3D interactive facial avatar capable of displaying non-verbal feedback, including pain signals. This avatar is projected onto a stereoscopic, view-dependent 3D display, offering a more immersive and realistic simulated patient experience for pain assessment practice. However, there is no existing solution that dynamically predicts and projects interactive 3D facial avatars in real-time. To overcome this, we emphasize the need for a 3D display projection system that can project the facial avatar holographically, allowing users to interact with the avatar from any viewpoint. By incorporating 3D Gaussian Splatting (3DGS) and real-time view-dependent calibration, we significantly improve the training environment for accurate pain recognition and assessment.
DynamicAvatars: Accurate Dynamic Facial Avatars Reconstruction and Precise Editing with Diffusion Models
School of Software Engineering, Xi’an Jiaotong University（西安交通大学软件学院）；National Engineering Research Center for Visual Information and Applications, Xi’an Jiaotong University（西安交通大学视觉信息与应用国家工程研究中心）；Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University（西安交通大学人工智能与机器人研究所）；National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Xi’an Jiaotong University（人机混合增强智能全国重点实验室）
DEGAS: Detailed Expressions on Full-Body Gaussian Avatars
The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；Prometheus Vision Technology Co., Ltd.（天视智能科技有限公司）；The Hong Kong University of Science and Technology（香港科技大学）；Swinburne University of Technology（斯威本科技大学）
AsynFusion: Towards Asynchronous Latent Consistency Models for Decoupled Whole-Body Audio-Driven Avatars
Institute of Artificial Intelligence (TeleAI), China Telecom（人工智能研究院（TeleAI）、中国电信）；Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing（未来区块链与隐私计算先进创新中心）；School of Artificial Intelligence, Beihang University（北航人工智能学院）；Hangzhou International Innovation Institute, Beihang University（杭州国际创新研究院，北航）；School of Computer Science and Technology, Xinjiang University（新疆大学计算机科学与技术学院）；GigaAI（极佳科技）
SMPLX-Lite: A Realistic and Drivable Avatar Benchmark with Rich Geometry and Texture Annotations
Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；Prometheus Vision Technology Co., Ltd.（普罗米修斯视觉科技有限公司）；Beijing University of Aeronautics and Astronautics（北京航空航天大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））
