利用用户访问模式和先进的网络基础设施加速共享科学观测站的数据交付
Leveraging User Access Patterns and Advanced Cyberinfrastructure to Accelerate Data Delivery from Shared-use Scientific Observatories
摘要：
随着共享使用的仪器和观测站的数量和可用性不断增加，观测数据正在成为应用工作流程的重要组成部分，并为一系列学科的科学发现做出贡献。然而，访问这些设施的用户数量的相应增长，加上数据规模和种类的扩大，使这些设施在确保其数据能够及时访问、集成和分析方面面临挑战，并对其网络基础设施（CI）产生了重大需求。在本文中，我们提出了一个基于推的数据交付框架，利用新兴的网络功能，以及基于混合数据管理模型的数据预取技术的设计。具体而言，我们分析了两个大型观测站，海洋观测站倡议（OOI）和大地测量设施的地球科学的进步（GAGE），以确定典型的用户访问模式，并开发一个模型，可用于数据预取的数据访问痕迹。此外，我们评估我们的数据预取模型和建议的框架，使用虚拟数据协作（VDC）平台，提供在网络中的数据分级和处理能力的模拟。结果表明，该框架的能力，以显着提高数据传输性能和减少网络流量的观测站的设施。
英文摘要：
With the growing number and increasing availability of shared-use instruments and observatories, observational data is becoming an essential part of application workflows and contributor to scientific discoveries in a range of disciplines. However, the corresponding growth in the number of users accessing these facilities coupled with the expansion in the scale and variety of the data, is making it challenging for these facilities to ensure their data can be accessed, integrated, and analyzed in a timely manner, and is resulting significant demands on their cyberinfrastructure (CI). In this paper, we present the design of a push-based data delivery framework that leverages emerging in-network capabilities, along with data pre-fetching techniques based on a hybrid data management model. Specifically, we analyze data access traces for two large-scale observatories, Ocean Observatories Initiative (OOI) and Geodetic Facility for the Advancement of Geoscience (GAGE), to identify typical user access patterns and to develop a model that can be used for data pre-fetching. Furthermore, we evaluate our data pre-fetching model and the proposed framework using a simulation of the Virtual Data Collaboratory (VDC) platform that provides in-network data staging and processing capabilities. The results demonstrate that the ability of the framework to significantly improve data delivery performance and reduce network traffic at the observatories' facilities.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
