A Systematic Survey on Large Language Models for Algorithm Design
City University of Hong Kong(香港城市大学);Huawei Noah’s Ark Lab(华为诺亚实验室);Xi'an Jiaotong University(西安交通大学);Huawei Cloud EI Service Product Dept.(华为云EI服务产品部);Southern University of Science(南方科技大学)
Algorithm design is crucial for effective problem-solving across various domains. The advent of Large Language Models (LLMs) has notably enhanced the automation and innovation within this field, offering new perspectives and promising solutions. In just a few years, this integration has yielded remarkable progress in areas ranging from combinatorial optimization to scientific discovery. Despite this rapid expansion, a holistic understanding of the field is hindered by the lack of a systematic review, as existing surveys either remain limited to narrow sub-fields or with different objectives. This paper seeks to provide a systematic review of algorithm design with LLMs. We introduce a taxonomy that categorises the roles of LLMs as optimizers, predictors, extractors and designers, analyzing the progress, advantages, and limitations within each category. We further synthesize literature across the three phases of the algorithm design pipeline and across diverse algorithmic applications that define the current landscape. Finally, we outline key open challenges and opportunities to guide future research. To support future research and collaboration, we provide an accompanying repository at: https://github.com/FeiLiu36/LLM4AlgorithmDesign.
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations
York University(约克大学);Dialpad Canada Inc.(Dialpad加拿大公司);Princess Nourah Bint Abdulrahman University(诺拉·宾特·阿卜杜勒拉赫曼公主大学);National Center for AI, Saudi Arabia(沙特阿拉伯国家人工智能中心);Nanyang Technological University(南洋理工大学);Royal Bank of Canada(加拿大皇家银行);Qatar Computing Research Institute (QCRI)(卡塔尔计算研究所);Salesforce Research(Salesforce研究院)
Large Language Models for Planning: A Comprehensive and Systematic Survey
The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, CASIA, and School of Artificial Intelligence, University of Chinese Academy of Sciences(认知与决策智能复杂系统重点实验室、中国科学院自动化研究所和中国科学院大学人工智能学院);Harbin Institute of Technology(哈尔滨工业大学);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Automation, Beijing Institute of Technology(北京理工大学自动化学院)
A Systematic Survey of Semantic Role Labeling in the Era of Pretrained Language Models
Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Shenzhen Loop Area Institute (SLAI)(深圳南山区研究院);University of Oslo(奥斯陆大学);Charles University(查尔斯大学)
Pre-trained Language Models in Biomedical Domain: A Systematic Survey
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));SRIBD(深圳市大数据研究院);University of Manchester(曼彻斯特大学);University of Amsterdam(阿姆斯特丹大学);Halmstad University(哈尔姆斯塔德大学);The University of Texas Health Science Center at Houston(德克萨斯大学休斯顿健康科学中心);Mila(米拉人工智能研究所);University of Montreal(蒙特利尔大学)
Behavioural vs. Representational Systematicity in End-to-End Models: An Opinionated Survey
School of Informatics, University of Edinburgh(信息学院,爱丁堡大学);Chemnitz University of Technology(技术大学,克明茨);Institute of Logic, Language, and Computation, University of Amsterdam(逻辑、语言与计算研究所,阿姆斯特丹大学);School of Philosophy, Psychology & Language Sciences, University of Edinburgh(哲学、心理学与语言科学学院,爱丁堡大学)
A Systematic Survey of Model Extraction Attacks and Defenses: State-of-the-Art and Perspectives
University of Notre Dame(诺丁汉大学);Florida State University(佛罗里达州立大学);Northwestern University(西北大学);Duke University(杜克大学);University of Southern California(南加州大学)
Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);AiRiA;Nanjing University of Information Science and Technology(南京信息科学技术大学)
A Systematic Survey on Federated Sequential Recommendation
School of Computer Science and Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院);The Hong Kong Polytechnic University(香港理工大学)
A Survey and Taxonomy of Distributed Data Mining Research Studies: A Systematic Literature Review
Dian Nuswantoro University(迪安努斯万托罗大学)
内容:数据采掘(Data Mining,DM)方法已经在逐年发展,并且到今天为止,还存在DM技术的增强,其运行速度可以比传统方法快几倍,称为分布式数据采掘(Distributed Data Mining,DDM)。它实际上并不是数据处理中的一个新领域,但近年来这方面的研究受到了越来越多的关注。问题:关于DDM在高声誉期刊和会议上的出版物数量显着增加。这使得研究者很难对DDM有一个全面的了解,需要进一步的研究。解决方案:我们进行了系统的文献回顾,以映射以前在DDM领域的研究。我们的目标是通过识别DDM领域的差距以及热点领域本身来为新的研究提供动力。结果:通过对文献综述中提出的7个研究问题的回答,得出了一些结论。此外,本文还对DDM的研究领域进行了分类。最后,本文对2000年至2015年DDM的发展进行了系统的文献综述,以帮助未来的研究者对DDM的发展现状有一个全面的了解。
Towards Mitigating Systematics in Large-Scale Surveys via Few-Shot Optimal Transport-Based Feature Alignment
Space Telescope Science Institute(太空望远镜科学研究所);South African Radio Astronomy Observatory(南非射电天文台);University of the Western Cape(南非西部大学);Johns Hopkins University(约翰霍普金斯大学)
MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Design
George Mason University(乔治梅森大学);Georgia Institute of Technology(佐治亚理工学院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Mila - Université de Montréal(米拉 - 蒙特利尔大学)