Retrieval algorithms like BM25 and query likelihood with Dirichlet smoothing remain strong and efficient first-stage rankers, yet improvements have mostly relied on parameter tuning and human intuition. We investigate whether a large language model, guided by an evaluator and evolutionary search, can automatically discover improved lexical retrieval algorithms. We introduce RankEvolve, a program evolution setup based on AlphaEvolve, in which candidate ranking algorithms are represented as executable code and iteratively mutated, recombined, and selected based on retrieval performance across 12 IR datasets from BEIR and BRIGHT. RankEvolve starts from two seed programs: BM25 and query likelihood with Dirichlet smoothing. The evolved algorithms are novel, effective, and show promising transfer to the full BEIR and BRIGHT benchmarks as well as TREC DL 19 and 20. Our results suggest that evaluator-guided LLM program evolution is a practical path towards automatic discovery of novel ranking algorithms.
Automating Bibliometric Analysis with Sentence Transformers and Retrieval-Augmented Generation (RAG): A Pilot Study in Semantic and Contextual Search for Customized Literature Characterization for High-Impact Urban Research
Oak Ridge National Laboratory(橡树岭国家实验室);The University of Tennessee(田纳西大学)
Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation
Wangxuan Institute of Computer Technology, Peking University(北京大学王轩计算机技术研究所);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究所);Peking University Law School(北京大学法学院)
Foam-Agent: A Large Language Model-Based Multi-Agent Framework for Automating Computational Fluid Dynamics Workflows
Department of Computer Science, Rensselaer Polytechnic Institute(里士满理工学院计算机科学系);Department of Mechanical, Aerospace, and Nuclear Engineering, Rensselaer Polytechnic Institute(里士满理工学院机械、航空航天与核工程系);Department of Computer Science and Engineering, University of California San Diego(加州大学圣地亚哥分校计算机科学与工程系);College of Education, Zhejiang Normal University(浙江师范大学教育学院);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院)
Harnessing multiple LLMs for Information Retrieval: A case study on Deep Learning methodologies in Biodiversity publications
Friedrich Schiller University Jena(耶拿弗里德里希·席勒大学);German Centre for Integrative Biodiversity Research (iDiv) Halle-Jena-Leipzig(哈雷-耶拿-莱比锡德国综合生物多样性研究中心(iDiv));Max Planck Institute for Biogeochemistry(马克斯·普朗克生物地球化学研究所);Michael Stifel Center Jena(耶拿迈克尔·施蒂费尔中心);Chemnitz University of Technology(开姆尼茨工业大学)
SuperLocalMemory V3.3: The Living Brain -- Biologically-Inspired Forgetting, Cognitive Quantization, and Multi-Channel Retrieval for Zero-LLM Agent Memory Systems
Automating the Detection of Requirement Dependencies Using Large Language Models
University of Ottawa(渥太华大学);École de technologie supérieure(超技术学院);Research Ireland Lero Centre for Software Research(爱尔兰Lero软件研究中心);University of Limerick(利默里克大学);General Motors(通用汽车公司)
ParaVul: A Parallel Large Language Model and Retrieval-Augmented Framework for Smart Contract Vulnerability Detection
School of Automation, Guangdong University of Technology(广东科技大學自動化學院);College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大學計算機科學與技術學院);School of Cyberspace Science and Technology, Beijing Jiaotong University(北京交通大學網絡空間科學與技術學院);School of Computer Science and Technology, Guangdong University of Technology(廣東科技大學計算機科學與技術學院);College of Computing and Data Science, Nanyang Technological University(南洋理工大學計算與數據科學學院)
Automating AI Failure Tracking: Semantic Association of Reports in AI Incident Database
University of Bergamo, Department of Management, Information and Production Engineering(博洛尼亚大学);University of Naples Federico II, Department of Electrical Engineering and Information Technology(那不勒斯费德里科二世大学);Northwestern University, Department of Computer Science, McCormick School of Engineering and Applied Science(西北大学)
SignalLLM: A General-Purpose LLM Agent Framework for Automated Signal Processing
Department of Electronic Engineering, Tsinghua University(清华大学电子工程系);School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore(南洋理工大学电子与电气工程学院);MARS Lab, Nanyang Technological University, Singapore(南洋理工大学MARS实验室)
LLM-Driven 3D Scene Generation of Agricultural Simulation Environments
Faculty of Applied Engineering – Dept. of Electronics and ICT, University of Antwerp(应用工程学院——电子与信息通信技术系,安特卫普大学);Flanders Make Strategic Research Centre(弗拉芒制造战略研究中心)