数据大爆炸与膨胀的数字宇宙：膨胀时代的高维、复杂和海量数据集
The Data Big Bang and the Expanding Digital Universe: High-Dimensional, Complex and Massive Data Sets in an Inflationary Epoch
AI总结：
针对天文领域因仪器和巡天发展产生的高维复杂海量数据难以用传统方法分析的问题，本文概述了其他学科的相关技术概念，旨在推动天文界掌握新方法，搭建跨学科研究桥梁。
摘要：
仪器设备近期及未来的进展，加上大型新巡天项目，正在产生天文学家熟悉的分析方法无法处理的天文数据集。传统方法往往力不从心，不仅是因为数据集的字节规模庞大，还因为现代数据集本身具有复杂性。在处理这类数据集时，常用算法和技术存在数学层面的局限性，因此迫切需要新的范式，用于跨应用领域的异构、多分辨率数据的表示、分析与科学可视化（区别于说明性可视化）。\n新数据集带来的部分问题已在应用数学、统计学、机器学习等其他学科得到解决，也已被空间地球科学等其他科学领域所采用。遗憾的是，与这些问题相关的有价值成果大多仅见于天文学以外的出版物。本文对若干概念、技术和进展进行了简要概述，其中既有“老牌”方法也有新兴成果。这些内容对大多数天文界人士而言普遍较为陌生，但对复杂数据集和图像的分析与可视化至关重要。\n为了让天文学家能够利用新时代数据的丰富性与复杂性，并且能够识别、采纳和应用新的解决方案，天文界需要对这些新概念具备一定程度的认知和理解。本文的目标之一就是帮助搭建应用数学、人工智能、计算机科学与天文学之间的桥梁，缩小两者之间的差距。
英文摘要：
Recent and forthcoming advances in instrumentation, and giant new surveys, are creating astronomical data sets that are not amenable to the methods of analysis familiar to astronomers. Traditional methods are often inadequate not merely because of the size in bytes of the data sets, but also because of the complexity of modern data sets. Mathematical limitations of familiar algorithms and techniques in dealing with such data sets create a critical need for new paradigms for the representation, analysis and scientific visualization (as opposed to illustrative visualization) of heterogeneous, multiresolution data across application domains. Some of the problems presented by the new data sets have been addressed by other disciplines such as applied mathematics, statistics and machine learning and have been utilized by other sciences such as space-based geosciences. Unfortunately, valuable results pertaining to these problems are mostly to be found only in publications outside of astronomy. Here we offer brief overviews of a number of concepts, techniques and developments, some "old" and some new. These are generally unknown to most of the astronomical community, but are vital to the analysis and visualization of complex datasets and images. In order for astronomers to take advantage of the richness and complexity of the new era of data, and to be able to identify, adopt, and apply new solutions, the astronomical community needs a certain degree of awareness and understanding of the new concepts. One of the goals of this paper is to help bridge the gap between applied mathematics, artificial intelligence and computer science on the one side and astronomy on the other.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
