Quantum Equilibrium Propagation for efficient training of quantum systems based on Onsager reciprocity
0
Sign in to get full access
Overview
- This paper presents a technique called "Quantum Equilibrium Propagation" for efficiently training quantum systems based on the Onsager reciprocity principle.
- The method aims to improve the training process of quantum neural networks and quantum simulators by leveraging the reciprocal relationship between the system's variables.
- The authors demonstrate the effectiveness of this approach through experiments on various quantum thermal cases.
Plain English Explanation
The paper discusses a new technique called Quantum Equilibrium Propagation for training quantum systems more efficiently. Quantum systems, such as quantum neural networks or quantum simulators, can be challenging to train due to their complex behavior.
The key insight behind this technique is the Onsager reciprocity principle, which states that there is a reciprocal relationship between the variables in a quantum system. The authors leverage this principle to develop a training algorithm that can improve the performance of equilibrium propagation without requiring weight symmetry.
Through experiments on various quantum thermal cases, the authors demonstrate that their Quantum Equilibrium Propagation technique can scale quantum neural networks and improve the training of physics-informed neural networks compared to traditional approaches.
Technical Explanation
The paper introduces a new technique called "Quantum Equilibrium Propagation" for efficiently training quantum systems. The authors leverage the Onsager reciprocity principle, which states that there is a reciprocal relationship between the variables in a quantum system. By incorporating this principle into the training process, the authors develop an algorithm that can improve the performance of equilibrium propagation without requiring weight symmetry.
The key steps of the Quantum Equilibrium Propagation technique are:
- Defining the quantum system's Hamiltonian, which describes the system's energy.
- Deriving the Onsager reciprocity relations between the system's variables.
- Incorporating the Onsager reciprocity relations into the training process to update the system's parameters.
The authors demonstrate the effectiveness of their approach through experiments on various quantum thermal cases, including the Ising model, the Potts model, and a quantum spin system. They show that their Quantum Equilibrium Propagation technique can scale quantum neural networks and improve the training of physics-informed neural networks compared to traditional approaches.
Critical Analysis
The paper presents a novel and promising approach for training quantum systems more efficiently. The authors' use of the Onsager reciprocity principle is an interesting and well-justified technique, as it leverages the inherent properties of quantum systems to improve the training process.
However, the paper does not discuss the potential limitations or caveats of the Quantum Equilibrium Propagation technique. For example, it is not clear how the method would perform on more complex or larger-scale quantum systems, or how sensitive it is to the accuracy of the Hamiltonian and Onsager reciprocity relations.
Additionally, the paper could have explored the potential implications of this technique for the broader field of quantum computing and simulation. It would be interesting to see how the Quantum Equilibrium Propagation approach could be applied to other quantum-based models and architectures, and what the long-term impact on the field might be.
Conclusion
In this paper, the authors present a novel technique called "Quantum Equilibrium Propagation" for efficiently training quantum systems. By leveraging the Onsager reciprocity principle, the authors develop an algorithm that can improve the performance of equilibrium propagation without requiring weight symmetry.
The authors demonstrate the effectiveness of their approach through experiments on various quantum thermal cases, showing that Quantum Equilibrium Propagation can scale quantum neural networks and improve the training of physics-informed neural networks compared to traditional methods.
This research represents an important step forward in the field of quantum computing and simulation, as it provides a new tool for efficiently training and optimizing quantum systems. The insights and techniques presented in this paper could have far-reaching implications for the development of more powerful and accurate quantum-based models and applications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Quantum Equilibrium Propagation for efficient training of quantum systems based on Onsager reciprocity
Clara C. Wanjura, Florian Marquardt
The widespread adoption of machine learning and artificial intelligence in all branches of science and technology has created a need for energy-efficient, alternative hardware platforms. While such neuromorphic approaches have been proposed and realised for a wide range of platforms, physically extracting the gradients required for training remains challenging as generic approaches only exist in certain cases. Equilibrium propagation (EP) is such a procedure that has been introduced and applied to classical energy-based models which relax to an equilibrium. Here, we show a direct connection between EP and Onsager reciprocity and exploit this to derive a quantum version of EP. This can be used to optimize loss functions that depend on the expectation values of observables of an arbitrary quantum system. Specifically, we illustrate this new concept with supervised and unsupervised learning examples in which the input or the solvable task is of quantum mechanical nature, e.g., the recognition of quantum many-body ground states, quantum phase exploration, sensing and phase boundary exploration. We propose that in the future quantum EP may be used to solve tasks such as quantum phase discovery with a quantum simulator even for Hamiltonians which are numerically hard to simulate or even partially unknown. Our scheme is relevant for a variety of quantum simulation platforms such as ion chains, superconducting qubit arrays, neutral atom Rydberg tweezer arrays and strongly interacting atoms in optical lattices.
Read more6/11/2024
🏋️
0
Quantum Equilibrium Propagation: Gradient-Descent Training of Quantum Systems
Benjamin Scellier
Equilibrium propagation (EP) is a training framework for energy-based systems, i.e. systems whose physics minimizes an energy function. EP has been explored in various classical physical systems such as resistor networks, elastic networks, the classical Ising model and coupled phase oscillators. A key advantage of EP is that it achieves gradient descent on a cost function using the physics of the system to extract the weight gradients, making it a candidate for the development of energy-efficient processors for machine learning. We extend EP to quantum systems, where the energy function that is minimized is the mean energy functional (expectation value of the Hamiltonian), whose minimum is the ground state of the Hamiltonian. As examples, we study the settings of the transverse-field Ising model and the quantum harmonic oscillator network -- quantum analogues of the Ising model and elastic network.
Read more6/4/2024
🌐
0
Equilibrium Propagation: the Quantum and the Thermal Cases
Serge Massar, Bortolo Matteo Mognetti
Equilibrium propagation is a recently introduced method to use and train artificial neural networks in which the network is at the minimum (more generally extremum) of an energy functional. Equilibrium propagation has shown good performance on a number of benchmark tasks. Here we extend equilibrium propagation in two directions. First we show that there is a natural quantum generalization of equilibrium propagation in which a quantum neural network is taken to be in the ground state (more generally any eigenstate) of the network Hamiltonian, with a similar training mechanism that exploits the fact that the mean energy is extremal on eigenstates. Second we extend the analysis of equilibrium propagation at finite temperature, showing that thermal fluctuations allow one to naturally train the network without having to clamp the output layer during training. We also study the low temperature limit of equilibrium propagation.
Read more5/15/2024
🎲
0
Improving equilibrium propagation without weight symmetry through Jacobian homeostasis
Axel Laborieux, Friedemann Zenke
Equilibrium propagation (EP) is a compelling alternative to the backpropagation of error algorithm (BP) for computing gradients of neural networks on biological or analog neuromorphic substrates. Still, the algorithm requires weight symmetry and infinitesimal equilibrium perturbations, i.e., nudges, to estimate unbiased gradients efficiently. Both requirements are challenging to implement in physical systems. Yet, whether and how weight asymmetry affects its applicability is unknown because, in practice, it may be masked by biases introduced through the finite nudge. To address this question, we study generalized EP, which can be formulated without weight symmetry, and analytically isolate the two sources of bias. For complex-differentiable non-symmetric networks, we show that the finite nudge does not pose a problem, as exact derivatives can still be estimated via a Cauchy integral. In contrast, weight asymmetry introduces bias resulting in low task performance due to poor alignment of EP's neuronal error vectors compared to BP. To mitigate this issue, we present a new homeostatic objective that directly penalizes functional asymmetries of the Jacobian at the network's fixed point. This homeostatic objective dramatically improves the network's ability to solve complex tasks such as ImageNet 32x32. Our results lay the theoretical groundwork for studying and mitigating the adverse effects of imperfections of physical networks on learning algorithms that rely on the substrate's relaxation dynamics.
Read more4/9/2024