Large-scale scientific collaborations, such as the Compact Muon Solenoid (CMS) at CERN, produce a vast and ever-growing corpus of internal documentation. Navigating this complex information landscape presents a significant challenge for both new and experienced researchers, hindering knowledge sharing and slowing down the pace of scientific discovery. To address this, we present a prototype of MITRA, a Retrieval-Augmented Generation (RAG) based system, designed to answer specific, context-aware questions about physics analyses. MITRA employs a novel, automated pipeline using Selenium for document retrieval from internal databases and Optical Character Recognition (OCR) with layout parsing for high-fidelity text extraction. Crucially, MITRA's entire framework, from the embedding model to the Large Language Model (LLM), is hosted on-premise, ensuring that sensitive collaboration data remains private. We introduce a two-tiered vector database architecture that first identifies the relevant analysis from abstracts before focusing on the full documentation, resolving potential ambiguities between different analyses. We demonstrate the prototype's superior retrieval performance against a standard keyword-based baseline on realistic queries and discuss future work towards developing a comprehensive research agent for large experimental collaborations.
An AI-Powered Research Assistant in the Lab: A Practical Guide for Text Analysis Through Iterative Collaboration with LLMs
Universidad Externado de Colombia(哥伦比亚外部大学);Universidad de los Andes(安第斯大学);University of Michigan(密歇根大学);Rice University(莱斯大学);University of Toronto(多伦多大学);University of Southampton(南安普顿大学)
AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment
Department of Computer Science and Technology, Tsinghua University(计算机科学与技术系,清华大学);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(人工智能学院,北京邮电大学)
Measuring Data Science Automation: A Survey of Evaluation Tools for AI Assistants and Agents
Leverhulme Centre for the Future of Intelligence, University of Cambridge, UK(未来智能研究中心、剑桥大学);Valencian Research Institute for Artificial Intelligence (VRAIN), Universitat Politècnica de València, Spain(瓦伦西亚人工智能研究 institutes (VRAIN)、瓦伦西亚理工大学)