arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.11469cs.DCphysics.data-an
收藏

SLAC和NERSC的实时XFEL数据分析:新生百亿亿次级实验数据分析的试运行

Real-Time XFEL Data Analysis at SLAC and NERSC: a Trial Run of Nascent Exascale Experimental Data Analysis

Johannes P. Blaschke, Aaron S. Brewster, Daniel W. Paley, Derek Mendez, Asmit Bhowmick, Nicholas K. Sauter, Wilko Kröger, Murali Shankar, Bjoern Enders, Deborah Bard

AI总结:

本研究在NERSC的Cori系统上利用Superfacility范式自动化LCLS与NERSC间的数据传输,采用CCTBX软件实现XFEL实验数据的实时分析,将数据采集到分子重建的周转时间缩短至10分钟,匹配采集速率,为应对数据增长趋势树立里程碑。

摘要:

使用自由电子激光器(XFELs)的X射线散射实验是确定未知样品(如COVID-19病毒蛋白)分子结构和功能的强大工具。XFEL实验在计算方面面临两大挑战:i) 由于运行XFEL的高成本,从数据采集到数据分析的快速周转时间对于就实验方案做出明智决策至关重要;ii) 数据采集速率呈指数级增长,需要新的可扩展算法。在此,我们报告了2020年9月在直线加速器相干光源(LCLS)进行的两次实验数据分析的经验。原始数据在NERSC的Cori XC40系统上使用Superfacility范式进行分析:我们的工作流自动在LCLS和NERSC之间移动原始数据,并在那里使用软件包CCTBX进行分析。我们实现了实时数据分析,从数据采集到完整分子重建的周转时间短至10分钟——这足以让实验操作员做出明智决策。通过将数据分析托管在Cori上,并自动化LCLS-NERSC互操作性,我们实现了与数据采集速率相匹配的数据分析速率。在10分钟内完成数据分析是XFEL实验的首次,也是我们跟上数据采集趋势的重要里程碑。

英文摘要:

X-ray scattering experiments using Free Electron Lasers (XFELs) are a powerful tool to determine the molecular structure and function of unknown samples (such as COVID-19 viral proteins). XFEL experiments are a challenge to computing in two ways: i) due to the high cost of running XFELs, a fast turnaround time from data acquisition to data analysis is essential to make informed decisions on experimental protocols; ii) data collection rates are growing exponentially, requiring new scalable algorithms. Here we report our experiences analyzing data from two experiments at the Linac Coherent Light Source (LCLS) during September 2020. Raw data were analyzed on NERSC's Cori XC40 system, using the Superfacility paradigm: our workflow automatically moves raw data between LCLS and NERSC, where it is analyzed using the software package CCTBX. We achieved real time data analysis with a turnaround time from data acquisition to full molecular reconstruction in as little as 10 min -- sufficient time for the experiment's operators to make informed decisions. By hosting the data analysis on Cori, and by automating LCLS-NERSC interoperability, we achieved a data analysis rate which matches the data acquisition rate. Completing data analysis with 10 mins is a first for XFEL experiments and an important milestone if we are to keep up with data collection trends.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑