arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.14358cs.SDcs.AIeess.AS
收藏

稳定音频打开

Stable Audio Open

Stability AI

Zach Evans, Julian D. Parker, CJ Carr, Zack Zukowski, Josiah Taylor, Jordi Pons

摘要:

开放生成模型对社区至关重要,允许微调并在呈现新模型时作为基线。然而,大多数当前的文本到音频模型都是私有的,艺术家和研究人员无法访问。在这里,我们描述了一个新的开放权重文本到音频模型的架构和训练过程,该模型使用知识共享数据进行训练。我们的评估表明,该模型的性能是具有竞争力的国家的最先进的各种指标。值得注意的是,报告的FDopenl3结果(测量世代的真实性)展示了其在44.1kHz的高质量立体声声音合成的潜力。

英文摘要:

Open generative models are vitally important for the community, allowing for fine-tunes and serving as baselines when presenting new models. However, most current text-to-audio models are private and not accessible for artists and researchers to build upon. Here we describe the architecture and training process of a new open-weights text-to-audio model trained with Creative Commons data. Our evaluation shows that the model's performance is competitive with the state-of-the-art across various metrics. Notably, the reported FDopenl3 results (measuring the realism of the generations) showcase its potential for high-quality stereo sound synthesis at 44.1kHz.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑