天文界的盛大对话:用AstroBridge将特殊天文数据与语言对齐
The Great Chat in the Sky: Aligning Exotic Astronomical Data to Language with AstroBridge
AI总结:
该研究提出AstroBridge框架,通过文献辅助管道将天文观测与LLM连接,在光谱分类任务中区分类星体与星系的准确率达91.5%,推动了天文数据与语言的对齐。
摘要:
天文观测包含图像、光谱和光变曲线,而科学文献则用自然语言描述这些天体。我们提出AstroBridge,这是一个通过文献辅助的标题生成管道将这些观测与大语言模型(LLM)连接起来的框架。我们利用目录元数据将观测与描述同一天体的科学文本进行匹配。一个视觉语言模型从观测的表征、匹配的段落和可用的元数据中生成描述性标题,从而在无需人工标注的情况下创建观测-标题对。我们训练AstroBridge直接从原始观测中预测标题。特定模态的冻结编码器提取表征,由一个可训练的共享融合网络将这些表征与LLM的嵌入空间对齐。在基于标题的光谱评估中,AstroBridge在区分类星体与星系方面达到了91.5%的准确率,而微调前的基础模型仅为69.0%。在星系形态、少数超新星类型的分类以及生成标题的事实准确性方面仍存在局限性。我们认为,AstroBridge的框架是朝着通过文本这一通用语言对齐天文学全部多样、特殊数据这一目标迈出的一步。
英文摘要:
Astronomical observations include images, spectra, and light curves, while the scientific literature describes these objects in natural language. We present AstroBridge, a framework that connects these observations to an LLM through a literature-assisted caption generation pipeline. We used catalog metadata to match observations with scientific texts that describe the same objects. A vision-language model generates descriptive captions from representations of observations, matched passages, and available metadata, creating observation-caption pairs without manual captioning. We train AstroBridge to predict captions directly from raw observations. Modality-specific frozen encoders extract representations that a shared, trainable fusion network aligns with the embedding space of an LLM. In caption-based evaluation of spectra, AstroBridge achieves 91.5% accuracy in distinguishing quasars from galaxies, compared to 69.0% from the base model prior to fine-tuning. Limitations remain in galaxy morphology, classification of minority supernova classes, and the factual quality of generated captions. We believe that AstroBridge's framework is a step towards the goal of aligning the totality of astronomy's diverse, exotic data through the lingua franca of text.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。