arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.07684astro-ph.GA
收藏

宇宙学模拟数据的多模态基础模型

Multi-modal Foundation Model for Cosmological Simulation Data

Georgia Institute of Technology(佐治亚理工学院);Argonne National Laboratory(阿贡国家实验室)

Bin Xia, Nesar Ramachandra, Azton I. Wells, Salman Habib, John Wise

AI总结:

本文提出一种仅编码器Transformer的多模态基础模型,通过动态掩码策略映射模拟与观测星系特征,在185,000个模拟星系上训练,显著提升红移与恒星质量估计精度,为连接模拟与观测提供统一框架。

摘要:

我们提出了一种面向天体物理星系数据的多模态基础模型,旨在建立基于模拟与基于观测的星系特征之间的映射。我们的仅编码器Transformer能够灵活地输入标量(如红移、星系质量)和向量(如恒星形成历史、光谱),支持包括模态内重建和跨模态预测在内的多任务训练。通过动态掩码策略,该模型可以从部分输入中查询任意星系属性——包括从红移和质量预测光谱,或从宽带星等估算测光红移——同时还能恢复模态内缺失的片段。该模型在来自千兆秒差距尺度宇宙学模拟的185,000个模拟星系上训练,在结合LSST和SPHEREx测光数据时,红移估计比仅使用LSST测光数据提高了50%;在结合晚期恒星形成历史与LSST测光数据时,恒星质量推断比早期恒星形成历史与LSST测光数据提高了63%。该模型在多模态任务中展现出强大的泛化能力,并为未来整合更高维度和结构化数据(如图像、合并树和三维场)奠定了基础。这种方法为连接模拟与观测提供了一个统一框架,推动了可泛化天体物理基础模型的发展。

英文摘要:

We present a multi-modal foundation model for astrophysical galaxy data, designed to map between simulation- and observation-based galactic features. Our encoder-only transformer flexibly ingests scalar quantities (e.g., redshifts, galaxy masses) and vectors (e.g., star formation histories, spectra), supporting multi-task training that includes within-modality reconstruction and cross-modality prediction. With a dynamic masking strategy, the model can query arbitrary galaxy properties from partial inputs -- including predicting spectra from redshift and mass, or estimating photometric redshifts from broadband magnitudes -- while also recovering missing segments within a modality. Trained on 185,000 simulated galaxies from a gigaparsec-scale Cosmology simulation, the model yields a 50% improvement in redshift estimation when combining LSST and SPHEREx photometry over LSST photometry alone, and a 63% improvement in stellar mass inference when combining late-time SFH with LSST photometry over early-time SFH with LSST photometry. The model demonstrates strong generalization across multi-modal tasks and lays the groundwork for future integration of higher-dimensional and structured data such as images, merger trees, and 3D fields. This approach provides a unified framework for connecting simulations and observations, advancing the development of generalizable astrophysical foundation models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑