Quantum computers promise massive computational speedup for problems in many critical domains, such as physics, chemistry, cryptanalysis, healthcare, etc. However, despite decades of research, they remain far from entering an era of utility. The lack of mature software, architecture, and systems solutions capable of translating quantum-mechanical properties of algorithms into physical state transformations on qubit devices remains a key factor underlying the slow pace of technological progress. The problem worsens due to significant reliance on domain-specific expertise, especially for software developers, computer architects, and systems engineers. To address these limitations and accelerate large-scale high-performance quantum system design, we ask:
Can large language models (LLMs) help with solving quantum software, architecture, and systems problems?
In this work, we present a case study assessing the performance of LLMs on quantum system reasoning tasks. We evaluate nine frontier LLMs and compare their performance to graduate UT Austin students on a set of quantum computing problems. Finally, we recommend several directions along which research and engineering development efforts must be pursued.
Walking the Tightrope of LLMs for Software Development: A Practitioners' Perspective
Faculty of Information Technology, Monash University(墨尔本大学信息科技学院);School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算机与信息系统学院)
From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future
School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院);University at Buffalo, SUNY(纽约州立大学布法罗分校);University of Chicago(芝加哥大学)
Using LLMs in Software Design: An Empirical Study of GitHub and A Practitioner Survey
School of Computer Science, Wuhan University(武汉大学计算机学院);School of Computer Science, Central China Normal University(中央财经大学计算机学院);School of Computing Technologies, RMIT University(皇家墨尔本理工大学计算技术学院);M3S Research Unit, University of Oulu(奥卢大学M3S研究单位);School of Computer Science, Nanjing University of Science(南京理工大学计算机学院)
On the Challenges of Fuzzing Techniques via Large Language Models
School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院);The University of Sydney(悉尼大学);Department of Computer Science, The University of Tokyo(东京大学计算机科学系);The University of Tokyo(东京大学)
Get on the Train or be Left on the Station: Using LLMs for Software Engineering Research
Colorado State University(科罗拉多州立大学);University of Bari(巴里大学);University of Auckland(奥克兰大学);IT University of Copenhagen(哥本哈根IT大学);University of Victoria(维多利亚大学)
Taxonomy of migration scenarios for Qiskit refactoring using LLMs
Universidad Nacional de La Plata, Facultad de Informática Laboratorio de Investigación y Formación en Informática Avanzada (LIFIA), Argentina(拉普拉塔国立大学计算机学院高级信息技术研究与培训实验室,阿根廷)
本研究面向 Qiskit 版本迁移中的量子代码重构问题,比较专家与 LLM 构建的分类体系并整合为统一框架,以支持 AI 辅助迁移和自动化重构评估。
Large Language Models for Software Engineering: A Systematic Literature Review
Huazhong University of Science and Technology(华中科技大学);Monash University(莫纳什大学);Singapore Management University(新加坡管理大学);Beihang University(北京航空航天大学);The Hong Kong Polytechnic University(香港理工大学)
Test It Before You Trust It: Applying Software Testing for Trustworthy In-context Learning
Advanced Institute of So-Go-Chi (Convergence Knowledge) Informatics(融合知识研究院);Tohoku University(东北大学);Japan Advanced Institute of Science and Technology(日本先进科学研究院);Faculty of Information and Communication Technology(信息与通信技术学院);Mahidol University(玛希敦大学)