Contemporary approaches to solving various problems that require analyzing three-dimensional (3D) meshes and point clouds have adopted the use of deep learning algorithms that directly process 3D data such as point coordinates, normal vectors and vertex connectivity information. Our work proposes one such solution to the problem of positioning body and finger animation skeleton joints within 3D models of human bodies. Due to scarcity of annotated real human scans, we resort to generating synthetic samples while varying their shape and pose parameters. Similarly to the state-of-the-art approach, our method computes each joint location as a convex combination of input points. Given only a list of point coordinates and normal vector estimates as input, a dynamic graph convolutional neural network is used to predict the coefficients of the convex combinations. By comparing our method with the state-of-the-art, we show that it is possible to achieve significantly better results with a simpler architecture, especially for finger joints. Since our solution requires fewer precomputed features, it also allows for shorter processing times.
SkelGen4D: Weakly-Supervised Skeleton-Based 4D Generation for Text-Driven Mesh Animation
School of Data Science, Lingnan University(岭南大学数据科学学院);Department of Computer Science and Engineering, Chinese University of Hong Kong(香港中文大学计算机科学与工程系);Autodesk Research(Autodesk研究院);Institute of Computer Applications, Shanghai Jiao Tong University(上海交通大学计算机应用研究所)
PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Tasks
School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);The University of Tokyo(东京大学);School of Science, Edith Cowan University(埃迪斯·科温大学科学学院);Meta Reality Labs(Meta现实实验室);Hong Kong Polytechnic University(香港理工大学)
Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories
School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学技术学院);State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), CASIA(多模态人工智能系统全国重点实验室(MAIS),中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Learning Character-Agnostic Motion for Motion Retargeting in 2D
Tel-Aviv University(特拉维夫大学);AICFVE Beijing Film Academy(北京电影学院AICFVE);Peking University(北京大学);Shandong University(山东大学);Hebrew University of Jerusalem(耶路撒冷希伯来大学)
Stem-leaf segmentation and phenotypic trait extraction of maize shoots from three-dimensional point cloud
College of Information and Electrical Engineering, Shenyang Agricultural University(沈阳农业大学信息与电气工程学院);School of Information and Intelligence Engineering, University of Sanya(三亚学院信息与智能工程学院)
S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modeling
Uber Advanced Technologies Group(优步先进技术集团);University of Toronto(多伦多大学);University of Southern California(南加州大学);Massachusetts Institute of Techonology(麻省理工学院)
DisPose: Disentangling Pose Guidance for Controllable Human Image Animation
Peking University(北京大学);University of Science and Technology of China(中国科学技术大学);Tsinghua University(清华大学);Hong Kong University of Science and Technology(香港科技大学)
Skeleton Transformer Networks: 3D Human Pose and Skinned Mesh from Single RGB Image
National Institute of Advanced Industrial Science and Technology (AIST)(国立先进工业科学技术研究所(AIST));CNRS-AIST JRL (Joint Robotics Laboratory), UMI3218/RL(法国国家科学研究中心-国立先进工业科学技术研究所联合机器人实验室(UMI3218/RL))
DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion
The University of Hong Kong (HKU)(香港大学);Astribot(星动科技);Tencent(腾讯);University of Science and Technology of China (USTC)(中国科学技术大学);International Digital Economy Academy (IDEA)(国际数字经济学院)
3D Scene-Adaptive Trajectory-Controllable Human Image Animation with Camera Movement
Engineering Research Center of Autonomous Unmanned System Technology(自主无人系统工程研究中心);Ministry of Education(教育部);Anhui Provincial Key Laboratory of Security Artificial Intelligence(安徽省安全人工智能重点实验室);School of Artificial Intelligence, Anhui University(安徽大学人工智能学院);University of Warwick(沃林格大学);Zhejiang Yuexiu University(浙江越秀大学);University of Surrey(萨里大学)
UNIF: United Neural Implicit Functions for Clothed Human Reconstruction and Animation
ZMO AI Inc.(ZMO人工智能公司);ShanghaiTech University(上海科技大学);Nanyang Technological University(南洋理工大学);Shanghai Engineering Research Center of Intelligent Vision and Imaging(上海智能视觉与成像工程研究中心);Shanghai Engineering Research Center of Energy Efficient and Custom AI IC(上海高效节能与定制人工智能芯片工程研究中心)
ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions
German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Max-Planck Institute for Informatics (MPII)(马克斯·普朗克信息学研究所);Saarland Informatics Campus(萨尔兰信息学园区)