为凯克天文台档案开发一个交互式指标仪表盘
An Interactive Metrics Dashboard for the Keck Observatory Archive
AI总结:
本文提出一个交互式仪表盘,用于实时监控凯克天文台档案的性能和增长,以支持其现代化和扩展需求。
摘要:
自2004年以来,凯克天文台档案(KOA)作为由NASA资助的联合项目,由NASA系外行星科学研究所(NExScI)和W.M.凯克天文台合作运营。它接收并提供所有由夏威夷玛努阿凯亚山上的双10米凯克望远镜获取的数据。在过去的三年中,KOA启动了一项现代化计划,以取代自档案创建以来使用的架构和系统,采用新的基于Python的基础设施。这种基础设施将使KOA能够应对新仪器所产生的快速增长和复杂数据集,同时能够进行后续处理,以应对如维拉·C·鲁宾天文台等新巡天望远镜预计产生的大量瞬态源警报。自2022年以来,KOA已能够近实时地接收新数据,通常在创建后的一分钟内,且已通过专用的网页界面立即将其提供给观测者。档案现在部署了新的、可扩展的、基于Python的、符合VO查询基础设施的查询架构,使用Plotly-Dash框架和R树索引,以将查询速度提升20倍。本文描述的项目利用新的查询基础设施开发了一个仪表盘,该仪表盘将实时返回档案性能和增长的指标。这些指标评估档案的当前状态,并指导未来硬件和软件升级的规划。这个单一仪表盘将能够例如监控实时数据摄入,以及研究档案的长期增长。自档案开放以来已存在的指标收集方法无法支持档案继续扩展。这些方法具有高延迟,不适用于按需指标,分散在各种工具中,并且使用起来繁琐。
英文摘要:
Since 2004, the Keck Observatory Archive (KOA) has operated as a NASA-funded collaboration between the NASA Exoplanet Science Institute ( NExScI) and the W.M. Keck Observatory. It ingests and serves all data acquired by the twin 10-meter Keck telescopes on Mauna Kea, Hawaii. In the past three years, KOA has begun a modernization program to replace the architecture and systems used since the archive's creation with a new modern Python-based infrastructure. This infrastructure will position KOA to respond to the rapid growth of new and complex data sets that will be acquired by new instruments now in development, and enable follow-up to identify the deluge of alerts of transient sources expected by new survey telescopes such as the Vera C. Rubin Observatory. Since 2022, KOA has ingested new data in near-real time, generally within one minute of creation, and has made them immediately accessible to observers through a dedicated web interface. The archive is now deploying a new, scalable, Python-based, VO-compliant query infrastructure built with the Plotly-Dash framework and R-tree indices to speed-up queries by a factor of 20. The project described here exploits the new query infrastructure to develop a dashboard that will return live metrics on the performance and growth of the archive. These metrics assess the current health of the archive and guide planning future hardware and software upgrades. This single dashboard will enable, for example, monitoring of real-time ingestion, as well as studying the long-term growth of the archive. Current methods of gathering metrics that have been in place since the archive opened will not support the archive as it continues to scale. These methods suffer from high latency, are not optimized for on-demand metrics, are scattered among various tools, and are cumbersome to use.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。