3D facial reconstruction from a single in-the-wild image is a crucial task in human-centered computer vision tasks. While existing methods can recover accurate facial shapes, there remains significant space for improvement in fine-grained expression capture. Current approaches struggle with irregular mouth shapes, exaggerated expressions, and asymmetrical facial movements. We present TEASER (Token EnhAnced Spatial modeling for Expressions Reconstruction), which addresses these challenges and enhances 3D facial geometry performance. TEASER tackles two main limitations of existing methods: insufficient photometric loss for self-reconstruction and inaccurate localization of subtle expressions. We introduce a multi-scale tokenizer to extract facial appearance information. Combined with a neural renderer, these tokens provide precise geometric guidance for expression reconstruction. Furthermore, TEASER incorporates a pose-dependent landmark loss to further improve geometric performances. Our approach not only significantly enhances expression reconstruction quality but also offers interpretable tokens suitable for various downstream applications, such as photorealistic facial video driving, expression transfer, and identity swapping. Quantitative and qualitative experimental results across multiple datasets demonstrate that TEASER achieves state-of-the-art performance in precise expression reconstruction.
TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstruction
State Key Laboratory of Complex and Critical Software Environment(复杂与关键软件环境国家重点实验室);School of Computer Science and Engineering(计算机科学与工程学院);School of Artificial Intelligence(人工智能学院)
CoANeRV: Coordinate-Aware Token-Space Neural Video Representation
College of Computer Science, Zhejiang University(浙江大学计算机科学学院);Zhejiang Key Laboratory of Accessible Perception and Intelligent Systems(浙江省无障碍感知与智能系统重点实验室)
WinTok: A Win-Win Hybrid Tokenizer via Decomposing Visual Understanding and Generation with Transferable Tokens
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);WeChat Vision, Tencent Inc.(腾讯微信视觉部);Shanghai Jiao Tong University(上海交通大学)
ReCal3R: Reliability-Calibrated Learning Rates for Streaming 3D Reconstruction
Beijing Normal-Hong Kong Baptist University(北京师范大学-香港浸会大学联合国际学院);Hong Kong Baptist University(香港浸会大学);Jilin University(吉林大学);Guangdong Provincial Key Laboratory of Interdisciplinary Research and Application for Data Science(广东省数据科学交叉研究与应用重点实验室);Nanyang Technological University(南洋理工大学)
RepWAM: World Action Modeling with Representation Visual-Action Tokenizers
Institute of Trustworthy Embodied AI, Fudan University(复旦大学可信具身人工智能研究所);Robbyant, Ant Group(蚂蚁集团 Robbyant);Hongkong University of Science and Technology(香港科技大学)
Bottlenecked semantic compression by representation reconstruction
Scientific Computing and Imaging Institute(科学计算与成像研究所);University of Utah(犹他大学);Princeton AI Lab(普林斯顿人工智能实验室);Princeton University(普林斯顿大学);National Institutes of Health(美国国立卫生研究院)
VesselTok: Tokenizing Vessel-like 3D Biomedical Graph Representations for Reconstruction and Generation
University of Zurich, Switzerland(苏黎世大学);ETH AI Center, Zurich, Switzerland(苏黎世联邦理工学院人工智能中心);Technical University of Munich, Germany(慕尼黑技术大学);Munich Center for Machine Learning (MCML), Germany(慕尼黑机器学习中心(MCML))
Quant Experts: Token-aware Adaptive Error Reconstruction with Mixture of Experts for Large Vision-Language Models Quantization
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence(人机混合增强智能国家重点实验室);Institute of Artificial Intelligence and Robotics(人工智能与机器人研究院);Xi’an Jiaotong University(西安交通大学)