QEVOLVE-Bench：量子SDK演进与修复规划的基础基准
QEVOLVE-Bench: A Seed Benchmark for Quantum SDK Evolution and Repair Planning
浏览论文内容
中文总结 AI 辅助
针对量子SDK演进导致的程序失败问题，提出QEVOLVE-Bench基础基准，含14个跨Qiskit等SDK的迁移任务及QEVOLVE-Agent原型，用于支持自动化修复与维护研究。
中文摘要 AI 辅助
量子软件日益构建在快速演进的Python SDK之上，如Qiskit、PennyLane和Cirq。当这些SDK演进时，用户程序可能因执行辅助函数被移除、导入路径变更、模拟器抽象转变、设备名称被弃用或电路导出接口被修订而失败。尽管某些失败表现为简单的缺失符号错误，但修复它们不仅是语法问题：开发者必须识别替代工作流程、保留面向量子的意图，并在固定框架版本下验证行为。本文提出了QEVOLVE-Bench，一个用于量子SDK演进的小型可执行基础基准。当前公开发布版包含14个跨Qiskit、PennyLane和Cirq的受控迁移任务。每个任务都是一个自包含的Python项目，具有固定依赖、失败和通过的输出、pytest验收检查、元数据和基准说明。该工件还包括清单、健全性检查器、代表性冒烟测试日志、Zenodo存档、录屏以及一个轻量级QEVOLVE-Agent原型，该原型将任务证据转换为结构化的修复提案。QEVOLVE-Bench并非一个具有统计功效的基准；相反，它是一个可扩展的基础工件，降低了研究自动化修复、基于LLM的软件工程以及基于量子SDK项目维护的设置成本。
英文摘要
Quantum software is increasingly built on fast-moving Python SDKs such as Qiskit, PennyLane, and Cirq. When these SDKs evolve, user programs can fail because execution helpers are removed, import paths change, simulator abstractions shift, device names are deprecated, or circuit export interfaces are revised. Although some failures surface as simple missing-symbol errors, repairing them is not only a syntactic problem: developers must identify the replacement workflow, preserve the quantum-facing intent, and validate behavior under pinned framework versions. This paper presents QEVOLVE-Bench, a small executable seed benchmark for quantum SDK evolution. The current public release contains 14 controlled migration tasks across Qiskit, PennyLane, and Cirq. Each task is a self-contained Python project with pinned dependencies, failing and passing outputs, pytest acceptance checks, metadata, and benchmark notes. The artifact also includes a manifest, sanity checker, representative smoke-test logs, Zenodo archive, screencast, and a lightweight QEVOLVE-Agent prototype that converts task evidence into structured repair proposals. QEVOLVE-Bench is intentionally not a statistically powered benchmark; instead, it is an extensible seed artifact that lowers the setup cost for studying automated repair, LLM-based software engineering, and maintenance of quantum SDK-based projects.
发表机构
- Fractal Analytics
- Indian Institute of Information Technology Dharwad（印度理工学院达瓦德分校）
机构由 AI 辅助整理，请以论文原文为准。
