A photorealistic and controllable 3D caricaturization framework for faces is introduced. We start with an intrinsic Gaussian curvature-based surface exaggeration technique, which, when coupled with texture, tends to produce over-smoothed renders. To address this, we resort to 3D Gaussian Splatting (3DGS), which has recently been shown to produce realistic free-viewpoint avatars. Given a multiview sequence, we extract a FLAME mesh, solve a curvature-weighted Poisson equation, and obtain its exaggerated form. However, directly deforming the Gaussians yields poor results, necessitating the synthesis of pseudo-ground-truth caricature images by warping each frame to its exaggerated 2D representation using local affine transformations. We then devise a training scheme that alternates real and synthesized supervision, enabling a single Gaussian collection to represent both natural and exaggerated avatars. This scheme improves fidelity, supports local edits, and allows continuous control over the intensity of the caricature. In order to achieve real-time deformations, an efficient interpolation between the original and exaggerated surfaces is introduced. We further analyze and show that it has a bounded deviation from closed-form solutions. In both quantitative and qualitative evaluations, our results outperform prior work, delivering photorealistic, geometry-controlled caricature avatars.
Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model
School of Mathematical Sciences, University of Science and Technology of China(中国科学技术大学数学科学学院);School of Data Science, University of Science and Technology of China(中国科学技术大学数据科学学院)
MeshSplats: Mesh-Based Rendering with Gaussian Splatting Initialization
Faculty of Mathematics and Computer Science, Jagiellonian University in Kraków(克拉科夫雅盖隆大学数学与计算机科学学院);Department of Engineering, University of Cambridge(剑桥大学工程系);IDEAS Research Institute(IDEAS研究所)
SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting
Shandong Technology and Business University(山东科技与商务大学);Nanchang Hangkong University(南昌航空大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of New South Wales(新南威尔士大学)
UniMGS: Unifying Mesh and 3D Gaussian Splatting with Single-Pass Rasterization and Proxy-Based Deformation
College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院);Fysics Intelligence Technologies Co., Ltd.(菲视智能科技有限公司);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学)
View-Consistent 3D Editing with Gaussian Splatting
Nanyang Technological University(南洋理工大学);Institute for Infocomm Research, A*STAR(新加坡资讯通信研究院(新加坡科技研究局下属));Singapore University of Technology and Design(新加坡科技设计大学);Skywork AI(天工AI);Hong Kong University of Science and Technology(香港科技大学)
MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenes
iComAI Lab, The Hong Kong University of Science and Technology(香港科技大学iComAI实验室);Skywork AI;The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院)
CAGS: Color-Adaptive Volumetric Video Streaming with Dynamic 3D Gaussian Splatting
Simon Fraser University(西蒙弗雷泽大学);Jiangxing Intelligence Inc.(江行智能有限公司);McGill University(麦吉尔大学);Nankai University(南开大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Fuzhou University(福州大学);Southeast University(东南大学)
ETH Zürich(苏黎世联邦理工学院);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Max Planck Institute for Informatics(马克斯·普朗克信息研究所);Tübingen AI Center(图宾根人工智能中心);Technical University of Munich(慕尼黑工业大学);Technical University of Darmstadt(达姆施塔特工业大学);Microsoft(微软)
Hybrid Explicit Representation for Ultra-Realistic Head Avatars
University of Science and Technology of China(中国科学技术大学);ShanghaiTech University(上海科技大学);Xi’an Jiaotong University(西安交通大学);Chinese Academy of Sciences(中国科学院);University of Hong Kong(香港大学)
DEGAS: Detailed Expressions on Full-Body Gaussian Avatars
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Prometheus Vision Technology Co., Ltd.(天视智能科技有限公司);The Hong Kong University of Science and Technology(香港科技大学);Swinburne University of Technology(斯威本科技大学)