arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.02138cs.CV
收藏

OmniLottie:通过参数化Lottie令牌生成向量动画

OmniLottie: Generating Vector Animations via Parameterized Lottie Tokens

Fudan University(复旦大学);StepFun(阶跃星辰);HKU MMLab(香港大学多媒体实验室);University of Queensland(昆士兰大学)

Yiying Yang, Wei Cheng, Sijin Chen, Honghao Fu, Xianfang Zeng, Yujun Cai, Gang Yu, Xingjun Ma

AI总结:

OmniLottie通过参数化Lottie令牌生成高质量向量动画,结合多模态指令与大规模数据集提升动画生成能力。

摘要:

OmniLottie是一个多功能框架,能够从多模态指令中生成高质量的向量动画。为了实现灵活的运动和视觉内容控制,我们专注于Lottie,一种轻量级的JSON格式,用于表示形状和动画行为。然而,原始的Lottie JSON文件包含大量不变的结构元数据和格式化令牌,这对学习向量动画生成带来了显著挑战。因此,我们引入了一个精心设计的Lottie分词器,将JSON文件转换为由命令和参数组成的结构化序列,代表形状、动画功能和控制参数。此类分词器使我们能够基于预训练的视觉语言模型构建OmniLottie,以遵循多模态交错的指令并生成高质量的向量动画。为进一步推进向量动画生成研究,我们整理了MMLottie-2M,一个大规模的专业向量动画数据集,配以文本和视觉注释。通过广泛的实验,我们验证了OmniLottie能够生成生动且语义对齐的向量动画,这些动画紧密遵循多模态的人类指令。

英文摘要:

OmniLottie is a versatile framework that generates high quality vector animations from multi-modal instructions. For flexible motion and visual content control, we focus on Lottie, a light weight JSON formatting for both shapes and animation behaviors representation. However, the raw Lottie JSON files contain extensive invariant structural metadata and formatting tokens, posing significant challenges for learning vector animation generation. Therefore, we introduce a well designed Lottie tokenizer that transforms JSON files into structured sequences of commands and parameters representing shapes, animation functions and control parameters. Such tokenizer enables us to build OmniLottie upon pretrained vision language models to follow multi-modal interleaved instructions and generate high quality vector animations. To further advance research in vector animation generation, we curate MMLottie-2M, a large scale dataset of professionally designed vector animations paired with textual and visual annotations. With extensive experiments, we validate that OmniLottie can produce vivid and semantically aligned vector animations that adhere closely to multi modal human instructions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑