arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1907.06183astro-ph.IMcs.DC
收藏

TAIGA实验原始数据元数据提取

Metadata Extraction from Raw Astroparticle Data of TAIGA Experiment

Igor Bychkov, Julia Dubenskaya, Elena Korosteleva, Alexandr Kryukov, Andrey Mikhailov, Minh-Duc Nguyen, Alexey Shigarov

摘要:

今天,运行中的TAIGA(用于宇宙射线和伽马天文学的Tunka高级仪器)实验不断产生和积累大量原始天体粒子数据。为了向科学界提供这些数据,应当对这些数据进行详细描述并正式定性。元数据的使用使得有可能通过统一的接口按时间和设备搜索和汇总数字对象(例如事件和运行)以访问它们。元数据的重要部分隐藏在文件夹/文件名和包头中。这种元数据应该从二进制文件中提取出来,转换成统一形式的数字对象,并加载到目录中。为了解决这一挑战,我们开发了一个概念的元数据提取器,可以扩展的设施特定的提取模块。它的目的是自动收集描述元数据从原始数据文件的所有TAIGA格式。

英文摘要:

Today, the operating TAIGA (Tunka Advanced Instrument for cosmic rays and Gamma Astronomy) experiment continuously produces and accumulates a large volume of raw astroparticle data. To be available for the scientific community these data should be well-described and formally characterized. The use of metadata makes it possible to search for and to aggregate digital objects (e.g. events and runs) by time and equipment through a unified interface to access them. The important part of the metadata is hidden and scattered in folder/files names and package headers. Such metadata should be extracted from binary files, transformed to a unified form of digital objects, and loaded into the catalog. To address this challenge we developed a concept of the metadata extractor that can be extended by facility-specific extraction modules. It is designed to automatically collect descriptive metadata from raw data files of all TAIGA formats.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑