使用编码智能体构建研究软件目录:从黑客松原型到公开部署
Building a research-software catalog with a coding agent: from hackathon prototype to public deployment
- Institute for Solid State Physics, The University of Tokyo(东京大学固体物理研究所)
机构由 AI 辅助整理,请以论文原文为准。
AI总结:
本文介绍了用编码智能体开发研究软件目录的原型,经工程优化实现公开部署,还探索了将相关经验迁移至MateriApps门户的可能性,指出AI辅助软件门户需明确验证,策划元数据仍关键。
AI中文摘要:
生成式AI与编码智能体可加速研究软件开发,但也提升了高效软件发现与维护的需求。我们在为期三天的黑客松期间开发了一个仓库目录,随后研究了使其适用于公开部署所需的工程工作,包括对抗性审查、数据质量检查、浏览器级验证及发布保障措施。接着,我们探索了该原型的经验教训是否可迁移至更大规模的人工策划门户,方法是通过一款正在开发的检索智能体,该智能体针对MateriApps门户,结合了策划的门户元数据、外部文档、向量搜索及本地语言模型生成。使用编码智能体的实施过程十分迅速,但要实现可靠运行则需要大量额外工程工作:最关键的问题并非崩溃,而是产生看似合理却不完整或错误输出的隐性故障,这些故障源于数据采集不完整、评估误导以及检索或预处理故障。这些观察表明,AI辅助软件门户需要明确的验证、监控及反复审查,且策划的元数据与维护的文档仍然至关重要。MateriApps的工作属于探索性内容,仍在积极开发中,因此报告的观察结果为初步结论;不过,类似的策划元数据、自动采集的文档及基于检索的辅助组合,或许可用于扩展其他研究软件门户。
英文摘要:
Generative AI and coding agents can accelerate research software development, but they also increase the need for efficient software discovery and maintenance. We developed a repository catalog during a three-day hackathon and subsequently examined the engineering required to make it suitable for public deployment, including adversarial review, data-quality checks, browser-level validation, and publication safeguards. We then explored whether the lessons learned from this prototype could be transferred to a much larger, human-curated portal, through a retrieval agent under development for MateriApps that combines curated portal metadata, external documentation, vector search, and local language-model generation. Implementation with coding agents was rapid, but achieving reliable operation required substantial additional engineering: the most consequential problems were not crashes but silent failures that produced plausible yet incomplete or incorrect outputs, arising from incomplete data acquisition, misleading assessments, and retrieval or preprocessing failures. These observations suggest that AI-assisted software portals require explicit validation, monitoring, and repeated review, and that curated metadata and maintained documentation remain essential. The MateriApps work is exploratory and remains under active development, so the observations reported for it are preliminary; a comparable combination of curated metadata, automatically collected documentation, and retrieval-based assistance may nevertheless be useful for extending other research-software portals.