Data Transfer and Network Services management for Domain Science Workflows
Tom Lehman, Xi Yang, Chin Guok, Frank Wuerthwein, Igor Sfiligoi, John Graham, Aashay Arora, Dima Mishin, Diego Davila, Jonathan Guiang, Tom Hutton, Harvey Newman, Justas Balcas
This paper describes a vision and work in progress to elevate network resources and data transfer management to the same level as compute and storage in the context of services access, scheduling, life cycle management, and orchestration. While domain science workflows often include active compute resource allocation and management, the data transfers and associated network resource coordination is not handled in a similar manner. As a result data transfers can introduce a degree of uncertainty in workflow operations, and the associated lack of network information does not allow for either the workflow operations or the network use to be optimized. The net result is that domain science workflow processes are forced to view the network as an opaque infrastructure into which they inject data and hope that it emerges at the destination with an acceptable Quality of Experience. There is little ability for applications to interact with the network to exchange information, negotiate performance parameters, discover expected performance metrics, or receive status/troubleshooting information in real time. Developing mechanisms to allow an application workflow to obtain information regarding the network services, capabilities, and options, to a degree similar to what is possible for compute resources is the primary motivation for this work. The initial focus is on the Open Science Grid (OSG)/Compact Muon Solenoid (CMS) Large Hadron Collider (LHC) workflows with Rucio/FTS/XRootD based data transfers and the interoperation with the ESnet SENSE (Software-Defined Network for End-to-end Networked Science at the Exascale) system.
Beyond Per-Request QoS: Coordinating Industrial Workflows with B5G/6G Network Capabilities
Ruhr University Bochum（波鸿鲁尔大学）；Fraunhofer Institute for Open Communication Systems (FOKUS)（弗劳恩霍夫开放通信系统研究所）；Hangzhou International Innovation Institute, Beihang University（北京航空航天大学杭州国际创新学院）
A Capability Broker for Workflow-Network QoS Coordination in B5G/6G Industrial Services
Ruhr University Bochum（波鸿鲁尔大学）；Fraunhofer Institute for Open Communication Systems (FOKUS)（弗劳恩霍夫开放通信系统研究所）；Hangzhou International Innovation Institute, Beihang University（北京航空航天大学杭州国际创新学院）
An SMDP-based Resource Management Scheme for Distributed Cloud Systems
本文研究了地理分布云系统中的资源管理问题。采用Follow Me Cloud概念，实现跨联合数据中心（DC）的服务迁移。因此，有两种类型的服务请求到DC，即，在本地服务区域中发起的新请求（NR）和当移动用户跨服务区域移动时生成的迁移请求（MR）。提出了一种新的资源管理方案，帮助资源管理器决定是否接受服务请求（NR或MR），并确定多少资源应分配给每个服务（如果接受）。优化目标是最大化系统平均回报，并保持服务请求的拒绝概率在一定的阈值之内。数值结果表明，与其他资源管理方案相比，该方案能显著提高系统的整体效用和用户体验.
