In information retrieval research, precision and recall have long been used to evaluate IR systems. However, given that a number of retrieval systems resembling one another are already available to the public, it is valuable to retrieve novel relevant documents, i.e., documents that cannot be retrieved by those existing systems. In view of this problem, we propose an evaluation method that favors systems retrieving as many novel documents as possible. We also used our method to evaluate systems that participated in the IREX workshop.
MemoNoveltyAgent: A Historical Research Memory-Aware Agent Workflow for Paper Novelty Assessment
Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China（计算与智能研究院，哈尔滨工业大学深圳校区，中国）；Xiaohongshu Inc.（小红书公司）；Zhongguancun Academy, Beijing, China（中关村学院，北京，中国）；NLP 2 CT Lab, Department of Computer and Information Science, University of Macau, China（自然语言处理2实验室，计算机与信息科学系，澳门大学，中国）
An Accuracy-Enhanced Stemming Algorithm for Arabic Information Retrieval
University of Setif1（塞提夫1大学）；Department of Computer Science（计算机科学系）
本文提出了一种基于自然语言处理的阿拉伯语文本索引和检索方法。我们的方法利用模板的概念，在词干和替换的话，他们的茎。该技术已被证明是有效的，因为它返回了显着的相关检索结果，减少沉默在检索阶段。本文通过一系列的实验来测试所提出的算法ESAIR（Enhanced Stemmer for Arabic信息检索）的性能。结果表明，该算法提取的准确率高达96%，因此，提高了信息检索的确切根。
Graph Your Way to Inspiration: Integrating Co-Author Graphs with Retrieval-Augmented Generation for Large Language Model Based Scientific Idea Generation
School of Computing Newcastle University（计算学院新castle大学）
MIRB: Mathematical Information Retrieval Benchmark
School of Mathematical Sciences, Peking University（北京大学数学科学学院）；Beijing International Center for Mathematical Research and the New Cornerstone Science Laboratory, Peking University（北京国际数学研究中心和新基石科学实验室，北京大学）；Center for Machine Learning Research, Peking University（北京大学机器学习研究中心）；Center for Intelligent Computing, Great Bay Institute for Advanced Study, Great Bay University（智能计算中心，大湾研究院高级研究所，大湾大学）
Harnessing Large Language Models for Scientific Novelty Detection
Nanyang Technological University（南洋理工大学）；Singapore University of Technology and Design（新加坡科技设计大学）；Agency for Science, Technology and Research (A*STAR)（新加坡科技研究局）
R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation
School of Computer Science, South China Normal University（华南师范大学计算机学院）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）
