audb——Python中音频与标注数据的共享与版本管理
audb -- Sharing and Versioning of Audio and Annotation Data in Python
AI总结:
audb是一个开源Python库,通过版本管理、依赖解析和部分加载机制,实现音频数据集的标准化共享与高效存储。
摘要:
由于需要更大、更多样化的数据集来预训练和微调日益复杂的机器学习模型,数据集的数量正在迅速增长。audb是一个开源的Python库,支持音频数据集的版本管理和文档化。它旨在提供一个标准化且简单的用户界面,用于发布、维护和访问数据集的标注和音频文件。为了在服务器上高效存储数据,audb自动解析数据集版本之间的依赖关系,并在发布新版本时仅上传新增或修改的文件。该库支持数据集的部分加载和本地缓存,以实现快速访问。audb是一个轻量级库,可以从任何机器学习库中进行接口调用。它支持在单台PC、大学或公司内部,乃至整个研究社区内管理数据集。
英文摘要:
Driven by the need for larger and more diverse datasets to pre-train and fine-tune increasingly complex machine learning models, the number of datasets is rapidly growing. audb is an open-source Python library that supports versioning and documentation of audio datasets. It aims to provide a standardized and simple user-interface to publish, maintain, and access the annotations and audio files of a dataset. To efficiently store the data on a server, audb automatically resolves dependencies between versions of a dataset and only uploads newly added or altered files when a new version is published. The library supports partial loading of a dataset and local caching for fast access. audb is a lightweight library and can be interfaced from any machine learning library. It supports the management of datasets on a single PC, within a university or company, or within a whole research community.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。