arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1407.3502astro-ph.IM
收藏

天气巡天海量数据流的自动实时分类和决策

Automated Real-Time Classification and Decision Making in Massive Data Streams from Synoptic Sky Surveys

S. G. Djorgovski, A. A. Mahabal, C. Donalek, M. J. Graham, A. J. Drake, M. Turmon, T. Fuchs

摘要:

科学和技术数据收集的性质正在迅速演变:数据量和速率呈指数级增长,复杂性和信息内容不断增加,从静态数据集过渡到必须进行实时分析的数据流。有趣或异常的现象必须通过有限资产的最佳部署来快速表征和跟进额外的测量。现代天文学在数字天气巡天中以瞬变事件的形式呈现了各种各样的这类现象,包括宇宙爆炸(超新星、伽马射线暴)、相对论现象(黑洞形成、喷流)、潜在危险的小行星等。我们一直在开发一套机器学习工具,用于检测、分类和规划对天文学应用中瞬态事件的响应,使用卡塔利娜实时瞬态调查(CRTS)作为科学和方法的测试平台。对可能最有趣的事件迅速作出反应的能力是一个关键的瓶颈,它限制了当前和预期的天气天空调查的科学回报。类似的挑战出现在其他情况下,从使用传感器网络的环境监测到自主航天器系统。考虑到数据速率的指数级增长和时间紧迫的响应,我们需要一种完全自动化和强大的方法。我们描述了迄今为止所取得的成果,以及未来可能的发展。

英文摘要:

The nature of scientific and technological data collection is evolving rapidly: data volumes and rates grow exponentially, with increasing complexity and information content, and there has been a transition from static data sets to data streams that must be analyzed in real time. Interesting or anomalous phenomena must be quickly characterized and followed up with additional measurements via optimal deployment of limited assets. Modern astronomy presents a variety of such phenomena in the form of transient events in digital synoptic sky surveys, including cosmic explosions (supernovae, gamma ray bursts), relativistic phenomena (black hole formation, jets), potentially hazardous asteroids, etc. We have been developing a set of machine learning tools to detect, classify and plan a response to transient events for astronomy applications, using the Catalina Real-time Transient Survey (CRTS) as a scientific and methodological testbed. The ability to respond rapidly to the potentially most interesting events is a key bottleneck that limits the scientific returns from the current and anticipated synoptic sky surveys. Similar challenge arise in other contexts, from environmental monitoring using sensor networks to autonomous spacecraft systems. Given the exponential growth of data rates, and the time-critical response, we need a fully automated and robust approach. We describe the results obtained to date, and the possible future developments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑