This paper considers a new problem of adapting a pre-trained model of human mesh reconstruction to out-of-domain streaming videos. However, most previous methods based on the parametric SMPL model \cite{loper2015smpl} underperform in new domains with unexpected, domain-specific attributes, such as camera parameters, lengths of bones, backgrounds, and occlusions. Our general idea is to dynamically fine-tune the source model on test video streams with additional temporal constraints, such that it can mitigate the domain gaps without over-fitting the 2D information of individual test frames. A subsequent challenge is how to avoid conflicts between the 2D and temporal constraints. We propose to tackle this problem using a new training algorithm named Bilevel Online Adaptation (BOA), which divides the optimization process of overall multi-objective into two steps of weight probe and weight update in a training iteration. We demonstrate that BOA leads to state-of-the-art results on two human mesh reconstruction benchmarks.
Bilevel Layer-Positioning LoRA for Real Image Dehazing
School of Computer Science and Engineering, Sun Yat-sen University（中山大学计算机科学与工程学院）；National Engineering Research Center of Digital Life（数字生活国家工程研究中心）；Dalian University of Technology（大连理工大学）；Xidian University（西安电子科技大学）
Domain Adaptive Object Detection via Dual-Stream Bilevel-Cycle Optimization
School of Cyber Science and Technology, Sun Yat-sen University（中山大学网络空间安全学院）；University of Chinese Academy of Sciences（中国科学院大学）；School of Computer Science and Technology, Anhui University（安徽大学计算机科学与技术学院）；PC Laboratory（PC实验室）
Anisotropic mesh adaptation for region-based segmentation accounting for image spatial information
Universitat Politècnica de Catalunya（加泰罗尼亚理工大学）；Centre Internacional de Mètodes Numèrics en Enginyeria (CIMNE)（国际工程数值方法中心）；Politecnico di Milano（米兰理工大学）
ExMesh: Explicit Mesh Reconstruction with Topology Adaptation
University of Science and Technology of China（中国科学技术大学）；National Key Laboratory of Deep Space Exploration, Deep Space Exploration Laboratory（国家空间科学探测重点实验室，深空探测实验室）
