The rise of Large Language Model-based Automated Algorithm Design (LLM-AAD) has transformed algorithm development by autonomously generating code implementations of expert-level algorithms. Unlike traditional expert-driven algorithm development, in the LLM-AAD paradigm, the main design principle behind an algorithm is often implicitly embedded in the generated code. Therefore, assessing algorithmic similarity directly from code, distinguishing genuine algorithmic innovation from mere syntactic variation, becomes essential. While various code similarity metrics exist, they fail to capture algorithmic similarity, as they focus on surface-level syntax or output equivalence rather than the underlying algorithmic logic.
We propose BehaveSim, a novel method to measure algorithmic similarity through the lens of problem-solving behavior as a sequence of intermediate solutions produced during execution, dubbed as problem-solving trajectories (PSTrajs). By quantifying the alignment between PSTrajs using dynamic time warping (DTW), BehaveSim distinguishes algorithms with divergent logic despite syntactic or output-level similarities. We demonstrate its utility in two key applications: (i) Enhancing LLM-AAD: Integrating BehaveSim into existing LLM-AAD frameworks (e.g., FunSearch, EoH) promotes behavioral diversity, significantly improving performance on three AAD tasks. (ii) Algorithm analysis: BehaveSim clusters generated algorithms by behavior, enabling systematic analysis of problem-solving strategies--a crucial tool for the growing ecosystem of AI-generated algorithms. Data and code of this work are open-sourced at https://github.com/RayZhhh/behavesim.
Beyond Truncation: Rethinking LLM Decoding as Ensemble Pruning
Institute of Statistics and Big Data, Renmin University of China(中国人民大学统计与大数据研究院);Big Data and Responsible Artificial Intelligence for National Governance, Renmin University of China(中国人民大学大数据与国家治理研究院);Center for Applied Statistics, Institute of Statistics and Big Data, Renmin University of China(中国人民大学统计与大数据研究院应用统计中心)
Rethinking Data Curation in LLM Training: Online Reweighting Offers Better Generalization than Offline Methods
University of Cambridge(剑桥大学);OATML, University of Oxford(牛津大学OATML实验室);University of Toronto(多伦多大学);Shanghai Jiao Tong University(上海交通大学);Samsung AI Center(三星人工智能中心)
Rethinking the Potential of Multimodality in Collaborative Problem Solving Diagnosis with Large Language Models
UCL Knowledge Lab, Institute of Education, University College London, UK(伦敦大学学院教育研究所知识实验室);AI Centre, Dept. of Computer Science, University College London, UK(伦敦大学学院人工智能中心)
Rethinking Efficient Graph Coarsening via a Non-Selfishness Principle
School of Information Science and Electronic Engineering, Shanghai Jiao Tong University, Shanghai, China(上海交通大学信息科学与电子工程学院);School of Artificial Intelligence, Shanghai Jiao Tong University, Shanghai, China(上海交通大学人工智能学院);School of Environment Science and Engineering, Shanghai Jiao Tong University, Shanghai, China(上海交通大学环境科学与工程学院);School of Artificial Intelligence, Nanchang University, Nanchang, China(南昌大学人工智能学院);Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing, China(中国科学院地理科学与资源研究所)
Rethinking Graph Contrastive Learning through Relative Similarity Preservation
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);Hangzhou Institute for Advanced Study, UCAS(国科大杭州高等研究院);School of Computing and Information Technology, Great Bay University(大湾区大学计算与信息技术学院);Department of Computer and Information Science, IOTSC, University of Macau(澳门大学计算机与信息科学系)
Just Rank: Rethinking Evaluation with Word and Sentence Similarities
National University of Singapore(新加坡国立大学);University of Southern California(南加州大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Kriston AI(科通智能)
Rethinking external validation for the target population: Capturing patient-level similarity with a generative model
Amsterdam UMC location University of Amsterdam, Dept of Medical Informatics(阿姆斯特丹大学医学中心(Amsterdam UMC)医学信息学系);Amsterdam Public Health Research Institute(阿姆斯特丹公共卫生研究所);Netherlands Heart Registration (NHR)(荷兰心脏登记处);Amsterdam UMC, Dept of Cardiology(阿姆斯特丹大学医学中心(Amsterdam UMC)心内科部);Institute for Logic, Language and Computation, University of Amsterdam(阿姆斯特丹大学逻辑、语言和计算研究所)
Rethinking Flexible Graph Similarity Computation: One-step Alignment with Global Guidance
College of Computer Science and Technology(计算机科学与技术学院);National University of Defense Technology(国防科技大学);Beihang University(北航);Information Support Force Engineering University(信息支援工程大学)
Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interaction
Texas A&M University(德克萨斯A&M大学);University of Waterloo(滑铁卢大学);UC San Diego(圣地亚哥大学);Stanford University(斯坦福大学);University of Washington(华盛顿大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Verdent AI;Lambda
Rethinking Client Drift in Federated Learning: A Logit Perspective
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究院);Hubei Luojia Laboratory(湖北珞珈实验室);Wuhan University(武汉大学);Harbin Institute of Technology(哈尔滨工业大学);The Hong Kong University of Science and Technology(香港科技大学);The Hong Kong Polytechnic University(香港理工大学);South China University of Technology(华南理工大学);Pazhou Lab(琶洲实验室)