Manipulate and control of the complex quantum system with high precision are essential for achieving universal fault tolerant quantum computing. For a physical system with restricted control resources, it is a challenge to control the dynamics of the target system efficiently and precisely under disturbances. Here we propose a multi-level dissipative quantum control framework and show that deep reinforcement learning provides an efficient way to identify the optimal strategies with restricted control parameters of the complex quantum system. This framework can be generalized to be applied to other quantum control models. Compared with the traditional optimal control method, this deep reinforcement learning algorithm can realize efficient and precise control for multi-level quantum systems with different types of disturbances.
We propose an analysis of the time-optimal control of a dissipative two-level quantum system whose dynamics is governed by the Lindblad equation. This simple system allows one to use tools of geometric control theory and to construct its optimal synthesis, i.e. to determine the set of all the optimal trajectories starting from a given initial point. We study different processes such as conversion of a pure state into a mixed state and purification of a mixed state. In particular cases, we show that dissipation is not undesirable and can help accelerating the control.
Optimal state transfer of a single two-level system (TLS) coupled to an Ohmic boson bath via off-diagonal TLS-bath coupling is studied by using optimal control theory. In the weak system-bath coupling regime where the time-dependent Bloch-Redfield formalism is applicable, we obtain the Bloch equation to probe the evolution of the dissipative TLS in the presence of a time-dependent external control field. By using the automatic differentiation technique to compute the gradient for the cost functional, we calculate the optimal transfer integral profile that can achieve an ideal transfer within a…
We investigate the optimal control problem for non-Markovian open, dissipative quantum system. Optimal control using Pontryagin maximum principle is specifically derived. The influences of Ohmic reservoir with Lorentz-Drude regularization are numerically studied in a two-level system under the following three conditions: ω_0\llω_c, ω_0\approxω_c or ω_0\ggω_c, where ω_0 is the characteristic frequency of the quantum system of interest, and ω_c the cut-off frequency of Ohmic reservoir. The optimal control process shows its remarkable influences on the decoherence dynamics. The temperature is a k…
We consider the problem of preparing specific encoded resource states for the toric code by local, time-independent interactions with a memoryless environment. We propose a construction of such a dissipative encoder which converts product states to topologically ordered ones while preserving logical information. The corresponding Liouvillian is made up of four-local Lindblad operators. For a qubit lattice of size $L\times L$, we show that this process prepares encoded states in time $O(L)$, which is optimal. This scaling compares favorably with known local unitary encoders for the toric code w…
We show that it is possible to modify the stationary state by a feedback control in a two-level dissipative quantum system. Based on the geometric control theory, we also analyze the effect of the feedback on the time-optimal control in the dissipative system governed by the Lindblad master equation. These effects are reflected in the function $Δ_A(\vec{x})$ and $Δ_B(\vec{x})$ that characterize the optimal trajectories, as well as the switching function $Φ(t)$ and $θ(t),$ which characterize the switching point in time for the time-optimal trajectory.
A formalism based on Pontryagin's maximum principle is applied to determine the time-optimal protocol that drives a general initial state to a target state by a Hamiltonian with limited control, i.e., there is a single control field with bounded amplitude. The coupling between the bath and the qubit is modeled by a Lindblad master equation. Dissipation typically drives the system to the maximally mixed state; consequently, there generally exists an optimal evolution time beyond which the decoherence prevents the system from getting closer to the target state. For some specific dissipation chan…
We study the correction of errors intervening in two-qubit dissipating into their own environments. This is done by resorting to local feedback actions with the aim of preserving as much as possible the initial amount of entanglement. Optimal control is found by first gaining insights from the subsystem purity and then by numerical analysis on the concurrence. This is tantamount to a double optimization, on the actuation and on the measurement processes. Repeated feedback action is also investigated, thus paving the way for a continuous time formulation and solution of the problem.
Optimal control methods for implementing quantum modules with least amount of relaxative loss are devised to give best approximations to unitary gates under relaxation. The potential gain by optimal control using relaxation parameters against time-optimal control is explored and exemplified in numerical and in algebraic terms: it is the method of choice to govern quantum systems within subspaces of weak relaxation whenever the drift Hamiltonian would otherwise drive the system through fast decaying modes. In a standard model system generalising decoherence-free subspaces to more realistic scen…
We combine a quantum dynamical propagator that explicitly accounts for quantum mechanical time ordering with optimal control theory. After analyzing its performance with a simple model, we apply it to a superconducting circuit under so-called Pythagorean control. Breakdown of the rotating-wave approximation is the main source of the very strong time-dependence in this example. While the propagator that accounts for the time ordering in an iterative fashion proves its numerical efficiency for the dynamics of the superconducting circuit, its performance when combined with optimal control turns o…
We study microwave-driven cooling in a superconducting flux qubit subjected to environment noises. For the weak decoherence, our analytical results agree well with the experimental observations near the degeneracy point and show that the microwave amplitude for optimal cooling should depend linearly on the dc flux detuning. With the decoherence increasing, more vibrational degrees of freedom couple in, making the ordinary cooling method less effective or even fail. We propose an improved cooling method, which can eliminate the perturbation of additional vibrational degrees of freedom hence kee…
We study the problem of optimal control of dissipative quantum dynamics. Although under most circumstances dissipation leads to an increase in entropy (or a decrease in purity) of the system, there is an important class of problems for which dissipation with external control can decrease the entropy (or increase the purity) of the system. An important example is laser cooling. In such systems, there is an interplay of the Hamiltonian part of the dynamics, which is controllable and the dissipative part of the dynamics, which is uncontrollable. The strategy is to control the Hamiltonian portion …
Entanglement generation can be robust against noise in approaches that deliberately incorporate dissipation into the system dynamics. The presence of additional dissipation channels may, however, limit fidelity and speed of the process. Here we show how quantum optimal control techniques can be used to both speed up the entanglement generation and increase the fidelity in a realistic setup, whilst respecting typical experimental limitations. For the example of entangling two trapped ion qubits [Lin et al., Nature 504, 415 (2013)], we find an improved fidelity by simply optimizing the polarizat…
We describe the optimal realization of entangling quantum gates for trapped ions mediated by a dissipative bus mode. With suitably shaped control pulses one can substantially decrease ion-phonon entanglement while maintaining the mediated interaction.
We show that optimizing a quantum gate for an open quantum system requires the time evolution of only three states irrespective of the dimension of Hilbert space. This represents a significant reduction in computational resources compared to the complete basis of Liouville space that is commonly believed necessary for this task. The reduction is based on two observations: The target is not a general dynamical map but a unitary operation; and the time evolution of two properly chosen states is sufficient to distinguish any two unitaries. We illustrate gate optimization employing a reduced set o…
We consider the time-optimal control by magnetic fields of a spin 1/2 particle in a dissipative environment. This system is used as an illustrative example to show the role of singular extremals in the control of quantum systems. We analyze a simple case where the control law is explicitly determined. We experimentally implement the optimal control using techniques of nuclear magnetic resonance. To our knowledge, this is the first experimental demonstration of singular extremals in quantum systems with bounded control amplitudes.
Optimal control theory, also known as Pontryagin's Maximum Principle, is applied to the quantum parameter estimation in the presence of decoherence. An efficient procedure is devised to compute the gradient of quantum Fisher information with respect to the control parameters and is used to construct the optimal control protocol. The proposed procedure keeps the control problem in the time-invariant form so that both first-order and second-order optimality conditions derived from Pontryagin's Maximum Principle apply; the second-order condition turns out to be crucial when the optimal control co…
We propose an efficient numerical method to compute configuration averages of observables in disordered open quantum systems whose dynamics can be unraveled via stochastic trajectories. We prove that the optimal sampling of trajectories and disorder configurations is simply achieved by considering one random disorder configuration for each individual trajectory. As a first application, we exploit the present method to the study the role of disorder on the physics of the driven-dissipative Bose-Hubbard model in two different regimes: (i) for strong interactions, we explore the dissipative physi…
We study the performance of a single qubit-laser as a quantum sensor to measure the amplitude and phase of a driving field. By using parameter estimation theory we show that certain suitable field quadratures are optimal observables in the lasing phase. The quantum Fisher information scales linearly with the number of bosons and thus the precision can be enhanced by increasing the incoherent pumping acting on the qubit. If we restrict ourselves to measurements of the boson number observable, then the optimal operating point is the critical point of the lasing phase transition. Our results poin…
Optimal transport is one of the primary goals for designing efficient quantum networks. In this work, the maximum transport is investigated for three-dimensional quantum networks with Platonic geometries affected by dephasing and dissipative Markovian noise. The network and the environmental characteristics corresponding the optimal design are obtained and investigated for five Platonic networks with 4, 6, 8, 12, and 20 number of sites that one of the sites is connected to a sink site through a dissipative process. Such optimal designs could have various applications like switching and multipl…
Geodesic steering for rapid dissipative entanglement distribution
Technical University of Munich（慕尼黑工业大学）；Walther-Meißner-Institut, Bayerische Akademie der Wissenschaften（瓦尔特·迈斯纳研究所，巴伐利亚科学院）；Munich Center for Quantum Science and Technology (MCQST)（慕尼黑量子科学与技术中心）
Spin squeezing of collective atomic spins can be achieved conditionally via probing with light and subsequent homodyne detection, as is done in a Quantum Nondemolition measurement. Recently it has been shown that squeezing can also be created unconditionally by a properly designed dissipative dynamics. We compare the two approaches in a Gaussian description, and optimize over all Gaussian light-matter interactions. We find that in the optimal unconditional scheme based on dissipation the level of squeezing scales as $d^{-1/2}$. In contrast, the optimal conditional scheme based on measurement o…
Various schemes have been proposed to overcome the drawback of the decoherence on quantum-enhanced parameter estimation. Here we suggest an alternative method, quantum feedback, to enhance the parameter precision of optimal quantum estimation of a dissipative qubit by investigating its dynamics of quantum Fisher information. We find that compared with the case without feedback, the quantum Fisher information of the dissipative qubit in the case of feedback has a large maximum value in time evolution and a smaller decay rate in the long time.
We study the effect of a thermal environment on the quantum annealing dynamics of a transverse-field Ising chain. The environment is modelled as a single Ohmic bath of quantum harmonic oscillators weakly interacting with the total transverse magnetization of the chain in a translationally invariant manner. We show that the density of defects generated at the end of the annealing process displays a minimum as a function of the annealing time, the so-called optimal working point, only in rather special regions of the bath temperature and coupling strength plane. We discuss the relevance of our r…
We apply deep reinforcement learning techniques to design high threshold decoders for the toric code under uncorrelated noise. By rewarding the agent only if the decoding procedure preserves the logical states of the toric code, and using deep convolutional networks for the training phase of the agent, we observe near-optimal performance for uncorrelated noise around the theoretically optimal threshold of 11%. We observe that, by and large, the agent implements a policy similar to that of minimum weight perfect matchings even though no bias towards any policy is given a priori.
We propose an experimentally feasible scheme for dissipative preparation of tripartite entangled state with atoms separately trapped in an array of three coupled cavities. The combination of coherent driving fields and quantum-jump-based feedback control will drive the system into a non-equilibrium steady state, which has a nearly perfect overlap with the genuine three-atom singlet state. Different control strategies are investigated and the corresponding optimal parameters are confirmed. Moreover, the fidelity of target state is insensitive to detection inefficiencies, and it oversteps 90\% f…
We present a comprehensive analysis of the performance of different classes of Gaussian states in the estimation of Gaussian phase-insensitive dissipative channels. In particular, we investigate the optimal estimation of the damping constant and reservoir temperature. We show that, for two-mode squeezed vacuum probe states, the quantum-limited accuracy of both parameters can be achieved simultaneously. Moreover, we show that for both parameters two-mode squeezed vacuum states are more efficient than either coherent, thermal or single-mode squeezed states. This suggests that at high energy regi…
Optimal control of a dissipative micromaser quantum battery in the ultrastrong coupling regime
Università degli Studi dell’Insubria（因苏布里亚大学）；INFN, Sezione di Milano（意大利国家核物理研究所米兰分部）；Università di Pavia（帕维亚大学）；INFN, Sezione di Pavia（意大利国家核物理研究所帕维亚分部）；Università di Catania（卡塔尼亚大学）；INFN, Sezione di Catania（意大利国家核物理研究所卡塔尼亚分部）
The average time required for an open quantum system to reach a steady state (the steady-state time) is generally determined through a competition of coherent and incoherent (dissipative) dynamics. Here, we study this competition for a ubiquitous central-spin system, corresponding to a `central' spin-1/2 coherently coupled to ancilla spins and undergoing dissipative spin relaxation. The ancilla system can describe $N$ spins-1/2 or, equivalently, a single large spin of length $I=N/2$. We find exact analytical expressions for the steady-state time in terms of the dissipation rate, resulting in a…
We show how to simulate numerically both the evolution of 1D quantum systems under dissipation as well as in thermal equilibrium. The method applies to both finite and inhomogeneous systems and it is based on two ideas: (a) a representation for density operators which extends that of matrix product states to mixed states; (b) an algorithm to approximate the evolution (in real or imaginary time) of such states which is variational (and thus optimal) in nature.
Freie Universität Berlin（柏林自由大学）；Rice University（莱斯大学）；Microsoft Research（微软研究院）
The optimal control of open quantum systems is a challenging task but has a key role in improving existing quantum information processing technologies. We introduce a general framework based on Reinforcement Learning to discover optimal thermodynamic cycles that maximize the power of out-of-equilibrium quantum heat engines and refrigerators. We apply our method, based on the soft actor-critic algorithm, to three systems: a benchmark two-level system heat engine, where we find the optimal known cycle; an experimentally realistic refrigerator based on a superconducting qubit that generates coher…
In this work we explore the use of thermodynamic length to improve the performance of experimental protocols. In particular, we implement Landauer erasure on a driven electron level in a semiconductor quantum dot, and compare the standard protocol in which the energy is increased linearly in time with the one coming from geometric optimisation. The latter is obtained by choosing a suitable metric structure, whose geodesics correspond to optimal finite-time thermodynamic protocols in the slow driving regime. We show experimentally that geodesic drivings minimise dissipation for slow protocols, …
