The demand for realistic and versatile character animation has surged, driven by its wide-ranging applications in various domains. However, the animation generation algorithms modeling human pose with 2D or 3D structures all face various problems, including low-quality output content and training data deficiency, preventing the related algorithms from generating high-quality animation videos. Therefore, we introduce MVAnimate, a novel framework that synthesizes both 2D and 3D information of dynamic figures based on multi-view prior information, to enhance the generated video quality. Our approach leverages multi-view prior information to produce temporally consistent and spatially coherent animation outputs, demonstrating improvements over existing animation methods. Our MVAnimate also optimizes the multi-view videos of the target character, enhancing the video quality from different views. Experimental results on diverse datasets highlight the robustness of our method in handling various motion patterns and appearances.
One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer
Jiangnan University(江南大学);University of Science and Technology of China(中国科学技术大学);Chinese Academy of Sciences(中国科学院);Beijing University of Posts and Telecommunications(北京邮电大学);Zhejiang University(浙江大学)
MultiAnimate: Pose-Guided Image Animation Made Extensible
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences(人工智能安全国家重点实验室,计算技术研究所,中国科学院);ShanghaiTech University(上海科技大学);Shanghai Jiao Tong University(上海交通大学)
IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Kling Team, Kuaishou Technology(快手技术 Kling 团队);Cardiff University(卡迪夫大学)
EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animation
University of Science and Technology of China(中国科学技术大学);Li Auto;Communication University of China(通信大学);MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, USTC(教育部脑科学与智能感知认知重点实验室,中国科学技术大学)
Animate-X++: Universal Character Image Animation with Dynamic Backgrounds
School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);Ant Group(蚂蚁集团);College of Letters and Science, The University of Wisconsin-Madison(文理学院,威斯康星大学麦迪逊分校);College of Computer Science, University of North Carolina at Chapel Hill(计算机科学学院,北卡罗来纳大学教堂山分校);School of Software, Tsinghua University(软件学院,清华大学)
AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation
Mohamed bin Zayed University of Artificial Intelligence, UAE(穆罕默德·本·扎耶德人工智能大学,阿联酋);University of Tromsø (UiT) – The Arctic University of Norway, Norway(特罗姆瑟大学(UiT)——挪威北极大学,挪威);Shenzhen campus of Sun Yet-sen University, China(孙中山大学深圳校区,中国)
SPECSIA: Stylization Dataset for Novel-View Enhancement in Drawing-based 3D Animation
School of Electrical Engineering, KAIST, Daejeon, Republic of Korea(韩国成均馆大学电子工程学院);Department of AI, Chung-Ang University, Seoul, Republic of Korea(韩国 Chung-Ang 大学人工智能系)
RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wild
DAMO Academy, Alibaba Group(达摩院,阿里巴巴集团);Zhejiang University(浙江大学);Hupan Lab(虎斑实验室);Southern University of Science and Technology(南方科技大学);Shenzhen University(深圳大学)
Bring Your Own Character: A Holistic Solution for Automatic Facial Animation Generation of Customized Characters
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);National University of Singapore(新加坡国立大学);University of Chinese Academy of Sciences(中国科学院大学)
本文提出一种自动生成定制虚拟人面部动画的整体方案,通过深度学习估计 blendshape 系数实现表情重定向,并开发 Unity 3D 工具包结合人在回路反馈优化,以加速 VR 面部动画生成。
MTVCraft: Tokenizing 4D Motion for Arbitrary Character Animation
Shenzhen Key Laboratory of Computer Vision and Pattern Recognition, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China(深圳计算机视觉与模式识别重点实验室,深圳先进技术研究院,中国科学院,深圳,中国);Institute of Artificial Intelligence (TeleAI), China Telecom, Beijing, China(人工智能研究所(TeleAI),中国电信,北京,中国);School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an, China(计算机科学与技术学院,西安交通大学,西安,中国);School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China(人工智能学院,中国科学院大学,北京,中国);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室,上海,中国)
SenseTime Research and Tetras.AI(商汤科技研究院与Tetras.AI);Rutgers University(罗格斯大学);Sun Yat-sen University(中山大学);Shanghai AI Laboratory(上海人工智能实验室);S-Lab Nanyang Technological University(南洋理工大学S-Lab)
DancingBox: A Lightweight MoCap System for Character Animation from Physical Proxies
University of Edinburgh 10 Crichton Street Edinburgh United Kingdom;Inria, Universit\' e C\ o te d'Azur 2004 route des lucioles Valbonne France;Tsinghua University No. 30 Shuangqing Road, Haidian District Beijing China;University of Edinburgh;Inria, Universit\' e C\ o te d'Azur;Tsinghua University
CoDance: An Unbind-Rebind Paradigm for Robust Multi-Subject Animation
The University of Hong Kong(香港大学);Ant Group(蚂蚁集团);Huazhong University of Science and Technology(华中科技大学);Tsinghua University(清华大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)
Erase but Preserve: Controllable Removal of Copyrighted Animation Characters via Optimized Semantic Anchors
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenes
Utopai Studios(Utopai工作室);University of California, Irvine(加州大学尔湾分校);Nanyang Technological University(南洋理工大学);Show Lab, National University of Singapore(新加坡国立大学Show Lab);National University of Singapore(新加坡国立大学)
Zero-shot High-fidelity and Pose-controllable Character Animation
Fudan University(复旦大学);Shanghai Key Lab of Intell. Info. Processing(上海智能信息处理重点实验室);School of CS, Fudan University(复旦大学计算机科学技术学院);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心);OPPO AI Center(OPPO人工智能中心);South China University Of Technology(华南理工大学);Westlake University(西湖大学)
MagicAnime: A Hierarchically Annotated, Multimodal and Multitasking Dataset with Benchmarks for Cartoon Animation Generation
National Centre for Computer Animation, Bournemouth University(伯恩茅斯大学计算机动画国家中心);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Hong Kong University of Science and Technology(香港科技大学);Department of Computer Science and Information Engineering, National Cheng Kung University(国立成功大学计算机科学与信息工程系)
Generative AI for Character Animation: A Comprehensive Survey of Techniques, Applications, and Future Directions
Computer Engineering Department, Sharif University of Technology(谢里夫理工大学计算机工程系);Iran University of Science and Technology(伊朗科学技术大学);Qatar Computing Research Institute(卡塔尔计算研究院)