Adviser:一种直观的多云平台,用于科学和机器学习工作流
Adviser: An Intuitive Multi-Cloud Platform for Scientific and ML Workflows
AI总结:
Adviser通过工作流抽象简化多云环境中的科学和机器学习工作流管理,帮助用户无需专业知识即可高效利用计算资源。
摘要:
有效利用现代云环境的庞大计算资源需要跨多个技术领域的专业知识:配置科学软件的正确参数和依赖项,导航成千上万的提供商特定实例类型和定价选项,以及管理并行或分布式执行。我们进行研究,表明缺乏这些领域的专业知识是解锁云启用计算科学潜力的持续挑战。为了解决这一挑战,我们介绍了Adviser,一种以工作流抽象为中心的直观多云平台。工作流是可重用的、由专家编写的制品,封装了执行科学和机器学习应用所需环境设置、数据处理、模拟、结果捕获和可视化步骤。这种方法允许用户指定高层次意图,而Adviser负责资源分配、运行时配置和数据移动。使用两个计算冰川代码,Icepack和PISM,我们展示了如何使用Adviser获得科学见解,并在不具有云或高性能计算专业知识的情况下快速探索成本-性能权衡和扩展行为。
英文摘要:
Effectively leveraging the vast computational resources of modern cloud environments requires expertise spanning multiple technical domains: configuring scientific software with correct parameters and dependencies, navigating thousands of provider-specific instance types and pricing options, and managing parallel or distributed execution. We conduct a study indicating that the absence of these categories of expertise poses an ongoing challenge to unlocking the potential of cloud-enabled computational science. To address this challenge, we introduce Adviser, an intuitive multi-cloud platform centered on a workflow abstraction. Workflows are reusable, expert-crafted artifacts encapsulating environment setup, data processing, simulation, result capture, and visualization steps needed to execute scientific and ML applications. This approach allows users to specify high-level intent, while Adviser handles resource provisioning, runtime configuration, and data movement. Using two computational glaciology codes, Icepack and PISM, we show how to use Adviser to gain scientific insight and perform rapid exploration of cost-performance tradeoffs and scaling behavior without specialized expertise in cloud or high-performance computing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。