arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.07530cs.DLcs.AIcs.CYcs.SI
收藏

科学领域中LLM的生命周期缩短

The Shrinking Lifespan of LLMs in Science

Computer Science & Artificial Intelligence Laboratory(计算机科学与人工智能实验室);Massachusetts Institute of Technology(麻省理工学院)

Ana Trišović

AI总结:

本研究通过分析62个LLM在超过10万篇引用论文中的科学采纳轨迹,发现模型的生命周期主要由发布年份决定,且每个后续发布年份的峰值时间和寿命分别缩短27%和23%。

摘要:

缩放定律描述了语言模型能力如何随计算和数据增长,但未说明模型发布后能持续多久。我们引入峰值时间和寿命作为模型过时的度量,并利用它们刻画62个LLM在超过10万篇引用论文(2019-2025年)中的科学采纳轨迹,将主动采纳与背景引用分离,以恢复引用计数无法解析的每个模型轨迹。我们发现,模型的寿命更多地由其发布时间而非特征决定:发布年份比架构、开放性或规模更能预测峰值时间和寿命。LLM的采纳遵循倒U型曲线(发布后上升、达到峰值然后下降),但这种模式正在迅速压缩。每个后续发布年份与峰值时间缩短27%和寿命缩短23%相关(p < 0.001),这一结果对最小年龄阈值和模型规模控制具有稳健性。这些采纳侧动态对缩放定律不可见,表明专注于任何单一模型可能是一项贬值的投资,其成本落在可重复性和迁移上。

英文摘要:

Scaling laws describe how language model capabilities grow with compute and data, but say nothing about how long a model matters once released. We introduce time-to-peak and lifespan as measures of model obsolescence and use them to characterize the scientific adoption trajectories of 62 LLMs across more than 108k citing papers (2019-2025), separating active adoption from background citation to recover per-model trajectories that citation counts cannot resolve. We find that a model's longevity is shaped more by when it was released than by its characteristics: release year predicts time-to-peak and lifespan more strongly than architecture, openness, or scale. LLM adoption follows an inverted-U curve (rising after release, peaking, and then declining), but this pattern is rapidly compressing. Each successive release year is associated with a 27% shorter time-to-peak and a 23% shorter lifespan ($p < 0.001$), robust to minimum-age thresholds and controls for model size. These adoption-side dynamics are invisible to scaling laws and suggest that specialization on any single model may be a depreciating investment, with costs falling on reproducibility and migration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑