arXiv 1601.024912016-01-11astro-ph.IM

IVOA Provenance data model: hints from the CTA Provenance prototype

Michèle Sanguillon, Mathieu Servillat, Mireille Louys, François Bonnarel, Catherine Boisson, Johan Brégeon

备注：: 4 pages, 3 figures, to appear in ADASS XXV proceedings, edited by N. P. F. Lorente, & K. Shortridge (San Francisco: ASP), ASP Conf. Ser

英文摘要：

We present the last developments on the IVOA Provenance data model, mainly based on the W3C PROV concept. In the context of the Cherenkov astronomy, the data processing stages imply both assumptions and comparison to dedicated simulations. As a consequence, Provenance information is crucial to the end user in order to interpret the high level data products. The Cherenkov Telescope Array (CTA), currently in preparation, is thus a perfect test case for the development of an IVOA standard on Provenance information. We describe general use-cases for the computational Provenance in the CTA production pipeline and explore the proposed W3C notations like PROV-N formats, as well as Provenance access solutions.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Implementation feedback of the IVOA Provenance data model

The IVOA Provenance Data model defines entities, agents and activities as container classes to describe the provenance of datasets, with the executed tasks and responsibilities attached to agents. It also provides a set of classes to describe the activities type and their configuration template, as well as the configuration applied effectively during the execution of a task. Here we highlight lessons learned in the implementation of the CDS ProvHiPS service distributing provenance metadata for the HST HiPS data collections, and for the HST archive original images used to produce the HiPS tiles…

2020-07-16astro-ph.IM

Provenance tools for Astronomy

In the context of astronomy projects, scientists have been confronted with the problem of describing in a standardized way how their data have been produced. As presented in a talk at last year's ADASS, the International Virtual Observatory Alliance (IVOA) is working on the definition of a Provenance Data Model, compatible with the W3C PROV model, which shall describe how provenance metadata can be modeled, stored and exchanged in astronomy. In this poster, we present the current status of our developments of libraries and tools, mainly open source, which implement the IVOA Provenance Data Mod…

2018-12-03astro-ph.IM

Evolution of the IVOA Characterisation Data Model

The Characterisation data model is a standard of the International Virtual Observatory Alliance (IVOA) that describes observational datasets in the multi-dimensional parameter space. Defining three properties: coverage, resolution, and sampling along different physical axes (e.g. spatial, spectral, flux) with variable level of details for the description, this model has been used in several IVOA contexts: Simple Spectral Access Protocol, Spectrum Data Model, ObsTAP (Table Access Protocol for the Core Components of the Observation Data Model. Here we propose a new version which addresses more c…

2011-12-21astro-ph.IM

Provenance as a requirement for large-scale complex astronomical instruments

We developed several pieces of software to enable the tracking of provenance information for the large-scale complex astronomical observatory CTA, the Cherenkov Telescope Array. Such major facilities produce data that will be publicly released to a large community of scientists. There are thus strong requirements to ensure data quality, reliability and trustworthiness. Among those requirements, traceability and reproducibility of the data products have to be included in the development of large projects. Those requirements can be answered by structuring and storing the provenance information f…

2018-06-01astro-ph.IM

Data Provenance: Use Cases for the ESO archive, and Interactions with the Virtual Observatory

In the Virtual Observatory era, where we intend to expose scientists (or software agents on their behalf) to a stream of observations from all existing facilities, the ability to access and to further interpret the origin, relationships, and processing steps on archived astronomical assets (their Provenance) is a requirement for proper observation selection, and quality assessment. In this article we present the different use cases Data Provenance is needed for, the challenges inherent to building such a system for the ESO archive, and their link with ongoing work in the International Virtual …

2010-02-02astro-ph.IM

Structuring metadata for the Cherenkov Telescope Array

The landscape of ground-based gamma-ray astronomy is drastically changing with the perspective of the Cherenkov Telescope Array (CTA) composed of more than 100 Cherenkov telescopes. For the first time in this energy domain, CTA will be operated as an observatory open to the astronomy community. In this context, a structured high level data model is being developed to describe a CTA observation. The data model includes different classes of metadata on the project definition, the configuration of the instrument, the ambient conditions, the data acquisition and the data processing. This last part…

2017-11-21astro-ph.IM

更多相关论文收起更多论文

Practical Provenance in Astronomy

Recently the International Virtual Observatory Alliance (IVOA) released a standard to structure provenance metadata, and several implementations are in development in order to capture, store, access and visualize the provenance of astronomy data products. This BoF will be focused on practical needs for provenance in astronomy. A growing number of projects express the requirement to propose FAIR data (Findable, Accessible, Interoperable and Reusable) and thus manage provenance information to ensure the quality, reliability and trustworthiness of this data. The concepts are in place, but now, ap…

2021-01-21astro-ph.IM

Provenance of astronomical data

In the context of Open Science, provenance has become a decisive piece of information to provide along with astronomical data. Provenance is explicitly cited in the FAIR principles, that aims to make research data Findable, Accessible, Interoperable and Reusable. The IVOA Provenance Data Model, published in 2020, puts in place the foundations for structuring and managing detailed provenance information, from the acquisition of raw data, to the dissemination of final products. The ambition is to provide for each astronomical dataset a sufficiently fine grained and detailed provenance informatio…

2022-04-25astro-ph.HEastro-ph.IM

Towards a Provenance Management System for Astronomical Observatories

We present here a provenance management system adapted to astronomical projects needs. We collected use cases from various astronomy projects and defined a data model in the ecosystem developed by the IVOA (International Virtual Observatory Alliance). From those use cases, we observed that some projects already have data collections generated and archived, from which the provenance has to be extracted (provenance "on top"), and some projects are building complex pipelines that automatically capture provenance information during the data processing (capture "inside"). Different tools and protot…

2021-09-16astro-ph.IMcs.ITmath.IT

IVOA Recommendation: Observation Data Model Core Components and its Implementation in the Table Access Protocol Version 1.0

This document defines the core components of the Observation data model that are necessary to perform data discovery when querying data centers for observations of interest. It exposes use-cases to be carried out, explains the model and provides guidelines for its implementation as a data access service based on the Table Access Protocol (TAP). It aims at providing a simple model easy to understand and to implement by data providers that wish to publish their data into the Virtual Observatory. This interface integrates data modeling and data access aspects in a single service and is named ObsT…

2011-11-14astro-ph.IM

LSTOSA: Onsite processing pipeline for the CTA Larged-Sized Telescope prototype

The prototype of the Large-Sized Telescope (LST) of the Cherenkov Telescope Array (CTA) is presently going through its commissioning phase. A total of four LSTs, among others, will operate together at Observatorio del Roque de Los Muchachos, which will host the CTA North site. A computing center endowed with 1760 cores and several petabytes disk space is installed onsite. It is used to acquire, process, and analyze the data produced, at a rate of 3~TB/hour during operation. The LST On-site Analysis LSTOSA is a set of scripts written in Python which connects the different steps of lstchain, the…

2021-01-24astro-ph.HEastro-ph.IM

FAIR solutions for a science platform to analyse Cherenkov data online

We developed a system to run quick analyses of Cherenkov data in compliance with the FAIR Guiding Principles for scientific data management (FAIR: Findable, Accessible, Interoperable and Reusable), through the use of interoperability standards and technologies, particularly those provided by the International Virtual Observatory Alliance (IVOA) to build the Virtual Observatory (VO). We therefore provide a controlled and stable environment on a computing cluster, in order to execute and re-execute well defined jobs. User-specific input parameters can be specified to configure the execution of a…

2023-01-10astro-ph.HEastro-ph.IM