针对可观测量非定域性、初始态纠缠和电路表达能力三类贫瘠高原来源提出统计模型，并证明任意两个 Pauli 可观测量在贫瘠高原区域以高概率反集中，为量子景观优化与热启动提供新认识。
摘要：
我们为贫瘠高原的三个主要来源分别引入统计模型：可观测量的非定域性、初始态的纠缠以及电路表达能力。例如，非定域可观测量由随机 Pauli 算子建模，这类算子以指数接近于一的概率导致贫瘠高原。这些模型是对传统确定性模型的补充，并且通常更易于分析。利用该框架，我们证明在贫瘠高原区域中，任意两个 Pauli 可观测量都以高概率反集中，其含义如下。尽管每个可观测量都局域于一个指数小的参数子空间，但这些区域本质上是相互独立的，因此它们的重叠比每个子空间还要指数级地更小。这促使人们重新思考具有贫瘠高原的量子景观结构及其优化方法，包括热启动策略。
英文摘要：
We introduce statistical models for each of the three main sources of barren plateaus: non-locality of the observable, entanglement of the initial state, and circuit expressivity. For instance, non-local observables are modeled by random Pauli operators, which lead to barren plateaus with probability exponentially close to one. These models are complementary to the conventional deterministic ones, and often simpler to analyze. Using this framework, we show that in the barren plateau regime any two Pauli observables are anti-concentrated with high probability in the following sense. While each of the observables is localized in an exponentially small parameter subspace, these regions are essentially independent, so that their overlap is yet exponentially smaller than each subspace. This invites to rethink the structure of quantum landscapes with barren plateaus and approaches to their optimization, including warm-start strategies.
Variational Quantum Algorithms (VQAs) have received considerable attention due to their potential for achieving near-term quantum advantage. However, more work is needed to understand their scalability. One known scaling result for VQAs is barren plateaus, where certain circumstances lead to exponentially vanishing gradients. It is common folklore that problem-inspired ansatzes avoid barren plateaus, but in fact, very little is known about their gradient scaling. In this work we employ tools from quantum optimal control to develop a framework that can diagnose the presence or absence of barren…
Defeating Barren Plateaus with Task-Aligned Symmetry
Faculty of Information Science and Engineering, Ocean University of China（中国海洋大学信息科学与工程学部）；China Telecom Quantum Information Technology Group Co., LTD.（中国电信量子信息技术集团有限公司）
Variational quantum algorithms are promising algorithms for achieving quantum advantage on near-term devices. The quantum hardware is used to implement a variational wave function and measure observables, whereas the classical computer is used to store and update the variational parameters. The optimization landscape of expressive variational ansätze is however dominated by large regions in parameter space, known as barren plateaus, with vanishing gradients which prevents efficient optimization. In this work we propose a general algorithm to avoid barren plateaus in the initialization and thro…
The existence of barren plateaus has recently revealed new training challenges in quantum machine learning (QML). Uncovering the mechanisms behind barren plateaus is essential in understanding the scope of problems that QML can efficiently tackle. Barren plateaus have recently been shown to exist when learning global properties of random unitaries, which is relevant when learning black hole dynamics. Establishing whether local cost functions can circumvent these barren plateaus is pertinent if we hope to apply QML to quantum many-body systems. We prove a no-go theorem showing that local cost f…
One of the most important properties of classical neural networks is how surprisingly trainable they are, though their training algorithms typically rely on optimizing complicated, nonconvex loss functions. Previous results have shown that unlike the case in classical neural networks, variational quantum models are often not trainable. The most studied phenomenon is the onset of barren plateaus in the training landscape of these quantum models, typically when the models are very deep. This focus on barren plateaus has made the phenomenon almost synonymous with the trainability of quantum model…
Parametrized quantum circuits initialized with random initial parameter values are characterized by barren plateaus where the gradient becomes exponentially small in the number of qubits. In this technical note we theoretically motivate and empirically validate an initialization strategy which can resolve the barren plateau problem for practical applications. The technique involves randomly selecting some of the initial parameter values, then choosing the remaining values so that the circuit is a sequence of shallow blocks that each evaluates to the identity. This initialization limits the eff…
From barren plateaus through fertile valleys: Conic extensions of parameterised quantum circuits
Institut für Theoretische Physik Leibniz Universität Hannover（汉诺威莱布尼茨大学理论物理研究所）；Institute for Quantum Information RWTH Aachen University（亚琛工业大学量子信息研究所）
Quantum compilation provides a method to translate quantum algorithms at a high level of abstraction into their implementations as quantum circuits on real hardware. One approach to quantum compiling is to design a parameterised circuit and to use techniques from optimisation to find the parameters that minimise the distance between the parameterised circuit and the target circuit of interest. While promising, such an approach typically runs into the obstacle of barren plateaus - i.e. large regions of parameter space in which the gradient vanishes. A number of recent works focusing on so-calle…
A large ongoing research effort focuses on Variational Quantum Algorithms (VQAs), representing leading candidates to achieve computational speed-ups on current quantum devices. The scalability of VQAs to a large number of qubits, beyond the simulation capabilities of classical computers, is still debated. Two major hurdles are the proliferation of low-quality variational local minima, and the exponential vanishing of gradients in the cost function landscape, a phenomenon referred to as barren plateaus. Here we show that by employing iterative search schemes one can effectively prepare the grou…
Variational quantum algorithms (VQAs) are widely applied in the noisy intermediate-scale quantum era and are expected to demonstrate quantum advantage. However, training VQAs faces difficulties, one of which is the so-called barren plateaus (BP) phenomenon, where gradients of cost functions vanish exponentially with the number of qubits. In this paper, inspired by transfer learning, where knowledge of pre-solved tasks could be further used in a different but related work with training efficiency improved, we report a parameter initialization method to mitigate BP. In the method, a small-sized …
Hybrid quantum-classical variational algorithms are one of the most propitious implementations of quantum computing on near-term devices, offering classical machine learning support to quantum scale solution spaces. However, numerous studies have demonstrated that the rate at which this space grows in qubit number could preclude learning in deep quantum circuits, a phenomenon known as barren plateaus. In this work, we implicate random entanglement as the source of barren plateaus and characterize them in terms of many-body entanglement dynamics, detailing their formation as a function of syste…
A Representation-Theoretic Framework for Characterizing Barren Plateaus
International Institute of Physics, Federal University of Rio Grande do Norte（北里奥格兰德联邦大学国际物理研究所）；Instituto de Física de São Carlos, Universidade de São Paulo（圣保罗大学圣卡洛斯物理研究所）
Experimental demonstration of the absence of noise-induced barren plateaus using information content landscape analysis
Honda Research Institute Europe GmbH（本田欧洲研究院）；Pitaevskii BEC Center, CNR-INO and Dipartimento di Fisica, Università di Trento（皮塔耶夫斯基玻色-爱因斯坦凝聚中心，意大利国家研究委员会光学研究所及特伦托大学物理系）；INFN-TIFPA, Trento Institute for Fundamental Physics and Applications（INFN-TIFPA，特伦托基础物理与应用研究院）
Barren plateaus are a notorious problem in the optimization of variational quantum algorithms and pose a critical obstacle in the quest for more efficient quantum machine learning algorithms. Many potential reasons for barren plateaus have been identified but few solutions have been proposed to avoid them in practice. Existing solutions are mainly focused on the initialization of unitary gate parameters without taking into account the changes induced by input data. In this paper, we propose an alternative strategy which initializes the parameters of a unitary gate by drawing from a beta distri…
Variational quantum algorithms (VQAs) are expected to establish valuable applications on near-term quantum computers. However, recent works have pointed out that the performance of VQAs greatly relies on the expressibility of the ansatzes and is seriously limited by optimization issues such as barren plateaus (i.e., vanishing gradients). This work proposes the state efficient ansatz (SEA) for accurate ground state preparation with improved trainability. We show that the SEA can generate an arbitrary pure state with much fewer parameters than a universal ansatz, making it efficient for tasks li…
Variational quantum eigensolvers (VQEs) represent a powerful class of hybrid quantum-classical algorithms for computing molecular energies. Various numerical issues exist for these methods, however, including barren plateaus and large numbers of local minima. In this work, we consider Adaptive, Problem-Tailored (ADAPT)-VQE ansätze, and examine how they are impacted by these local minima. We find that while ADAPT-VQE does not remove local minima, the gradient-informed, one-operator-at-a-time circuit construction seems to accomplish two things: First, it provides an initialization strategy that …
Quantum neural networks (QNNs) offer a powerful paradigm for programming near-term quantum computers and have the potential to speedup applications ranging from data science to chemistry to materials science. However, a possible obstacle to realizing that speedup is the Barren Plateau (BP) phenomenon, whereby the gradient vanishes exponentially in the system size $n$ for certain QNN architectures. The question of whether high-order derivative information such as the Hessian could help escape a BP was recently posed in the literature. Here we show that the elements of the Hessian are exponentia…
Can Chemically Inspired Parameter Initialization Mitigate Barren Plateaus in Variational Quantum Eigensolvers?
Guangdong Basic Research Center of Excellence for Aggregate Science, School of Science and Engineering, The Chinese University of Hong Kong (Shenzhen)（广东聚合科学卓越研究中心，科学与工程学部，香港中文大学（深圳））；School of Physical and Chemical Sciences, Queen Mary University of London（物理与化学科学学院，伦敦大学玛丽女王学院）
Optimizing parameterized quantum circuits (PQCs) is the leading approach to make use of near-term quantum computers. However, very little is known about the cost function landscape for PQCs, which hinders progress towards quantum-aware optimizers. In this work, we investigate the connection between three different landscape features that have been observed for PQCs: (1) exponentially vanishing gradients (called barren plateaus), (2) exponential cost concentration about the mean, and (3) the exponential narrowness of minina (called narrow gorges). We analytically prove that these three phenomen…
Los Alamos National Laboratory（洛斯阿拉莫斯国家实验室）；Center for Nonlinear Studies（非线性研究中心）
Barren plateau landscapes correspond to gradients that vanish exponentially in the number of qubits. Such landscapes have been demonstrated for variational quantum algorithms and quantum neural networks with either deep circuits or global cost functions. For obvious reasons, it is expected that gradient-based optimizers will be significantly affected by barren plateaus. However, whether or not gradient-free optimizers are impacted is a topic of debate, with some arguing that gradient-free approaches are unaffected by barren plateaus. Here we show that, indeed, gradient-free optimizers do not s…
Skolkovo Institute of Science and Technology（斯科尔科沃科学技术学院）
Variational quantum algorithms rely on gradient based optimization to iteratively minimize a cost function evaluated by measuring output(s) of a quantum processor. A barren plateau is the phenomenon of exponentially vanishing gradients in sufficiently expressive parametrized quantum circuits. It has been established that the onset of a barren plateau regime depends on the cost function, although the particular behavior has been demonstrated only for certain classes of cost functions. Here we derive a lower bound on the variance of the gradient, which depends mainly on the width of the circuit …
Tensor networks are efficient representations of high-dimensional tensors with widespread applications in quantum many-body physics. Recently, they have been adapted to the field of machine learning, giving rise to an emergent research frontier that has attracted considerable attention. Here, we study the trainability of tensor-network based machine learning models by exploring the landscapes of different loss functions, with a focus on the matrix product states (also called tensor trains) architecture. In particular, we rigorously prove that barren plateaus (i.e., exponentially vanishing grad…
Pacific Northwest National Laboratory（西北太平洋国家实验室）；University of Technology Sydney（悉尼科技大学）；University of Toronto（多伦多大学）
We argue that an excess in entanglement between the visible and hidden units in a Quantum Neural Network can hinder learning. In particular, we show that quantum neural networks that satisfy a volume-law in the entanglement entropy will give rise to models not suitable for learning with high probability. Using arguments from quantum thermodynamics, we then show that this volume law is typical and that there exists a barren plateau in the optimization landscape due to entanglement. More precisely, we show that for any bounded objective function on the visible layers, the Lipshitz constants of t…
Noise-Induced Barren Plateaus in Variational Quantum Algorithms
Los Alamos National Laboratory（洛斯阿拉莫斯国家实验室）；Imperial College London（伦敦帝国学院）；University of Strathclyde（思克莱德大学）；National Physical Laboratory（国家物理实验室）；Center for Nonlinear Studies, Los Alamos National Laboratory（洛斯阿拉莫斯国家实验室非线性研究中心）
