arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.07083cs.DB
收藏

echemdb Toolkit——一种为数据管理解决方案准备数据的轻量方法

echemdb Toolkit -- a Lightweight Approach to Getting Data Ready for Data Management Solutions

Albert K. Engstfeld, Johannes M. Hermann, Nicolas G. Hörmann, Julian Rüth

AI总结:

针对现有带元数据的科学数据存储方案通用性不足的问题,研究团队推出开源echemdb toolkit,采用基于文件的轻量方案实现数据与元数据管理,支持自动注释、格式转换、数据探索等功能,无需复杂配置,便于普通研究者使用。

摘要:

根据FAIR(可发现性、可访问性、互操作性和可重用性)原则,科学数据应始终连同机器可读的描述性元数据一同存储。现有的带元数据的数据存储解决方案,例如电子实验室笔记本(ELN),通常具有极强的领域特异性,通用性不足,无法适用于任意实验或计算结果。\n 在本研究中,我们推出了开源的echemdb toolkit(电化学数据库工具包),用于创建和处理数据与元数据。该工具包完全在文件系统层面运行,采用基于文件的方案,这既便于在FAIR数据生命周期中与其他工具集成,也意味着无需进行复杂的服务器配置。这还使得普通研究人员更易使用该工具包,因为他们无需掌握更复杂的数据库技术相关知识。\n 我们展示了该工具包的多个方面与应用:为原始研究数据自动添加人类和机器可读的元数据注释、将数据转换为标准化的frictionless Data Packages(无摩擦数据包),以及一个用于数据探索的API。我们还利用能量转换与存储研究的示例数据,演示了用于数据展示的Web框架。

英文摘要:

According to the FAIR (findability, accessibility, interoperability, and reusability) principles, scientific data should always be stored with machine-readable descriptive metadata. Existing solutions to store data with metadata, such as electronic lab notebooks (ELN), are often very domain-specific and not sufficiently generic for arbitrary experimental or computational results. In this work, we present open-source echemdb toolkit for creating and handling data and metadata. The toolkit is running entirely on the file system level using a file-based approach, which facilitates integration with other tools in a FAIR data life cycle and means that no complicated server setup is required. This also makes the toolkit more accessible to the average researcher since no understanding of more sophisticated database technologies is required. We showcase several aspects and applications of the toolkit: automatic annotation of raw research data with human- and machine-readable metadata, data conversion into standardised frictionless Data Packages, and an API for exploring the data. We also illustrate the web frameworks to illustrate the data using example data from research into energy conversion and storage.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑