Backpropagation through space, time, and the brain

Read original: arXiv:2403.16933 - Published 7/17/2024 by Benjamin Ellenberger, Paul Haider, Jakob Jordan, Kevin Max, Ismael Jaras, Laura Kriener, Federico Benitez, Mihai A. Petrovici

💬

Overview

This paper presents a comprehensive comparison of various approaches to building biologically plausible computing systems.
It explores the tradeoffs and considerations involved in designing neural networks that are more aligned with the structure and function of biological brains.
The paper covers topics such as Towards Biologically Plausible Computing: A Comprehensive Comparison, Contribute to Balance Wire Accordance Emergence Backpropagation, Two Tales of Single-Phase Contrastive Hebbian Learning, Emergent Representations in Networks Trained with the Forward-Forward Algorithm, and Improved Forward-Forward Contrastive Learning.

Plain English Explanation

The paper explores different ways to create artificial neural networks that more closely resemble the structure and function of biological brains. The researchers examine various techniques, such as Contribute to Balance Wire Accordance Emergence Backpropagation and Two Tales of Single-Phase Contrastive Hebbian Learning, that aim to make the computations in these networks more biologically plausible. This includes looking at how the connections between neurons are formed and how information is processed. The goal is to develop AI systems that are not only powerful but also more aligned with the way natural intelligence works. The paper also covers the Emergent Representations in Networks Trained with the Forward-Forward Algorithm and Improved Forward-Forward Contrastive Learning, which are approaches for training neural networks in a way that leads to the development of useful representations without relying on backpropagation, a technique that is not considered biologically realistic.

Technical Explanation

The paper presents a thorough investigation of various approaches to building biologically plausible neural networks. It examines techniques such as Contribute to Balance Wire Accordance Emergence Backpropagation, which aims to make the weight updates in a neural network more aligned with the way connections between neurons are strengthened and weakened in the brain. The paper also explores Two Tales of Single-Phase Contrastive Hebbian Learning, a learning rule that is inspired by the way neurons in the brain adapt their connections based on the correlation of their activities.

Additionally, the paper investigates Emergent Representations in Networks Trained with the Forward-Forward Algorithm and Improved Forward-Forward Contrastive Learning, which are methods for training neural networks without relying on backpropagation, a technique that is not considered biologically plausible. These approaches aim to develop useful internal representations in the networks through different learning mechanisms.

Critical Analysis

The paper provides a comprehensive and insightful analysis of the various approaches to building biologically plausible computing systems. It highlights the potential benefits of these techniques, such as greater alignment with the way natural intelligence works and the possibility of developing more efficient and robust AI systems.

However, the paper also acknowledges the significant challenges and limitations of these approaches. For example, the paper notes that some of the proposed techniques, such as Contribute to Balance Wire Accordance Emergence Backpropagation, may be computationally intensive and difficult to scale to larger networks. Additionally, the paper raises questions about the ability of these methods to capture the full complexity and dynamism of biological neural networks.

Further research and experimentation will be necessary to determine the practical viability and real-world efficacy of these biologically inspired computing approaches. It will be important to carefully evaluate their performance on a range of tasks and continue to refine the underlying theories and algorithms.

Conclusion

This paper presents a comprehensive exploration of various approaches to building biologically plausible computing systems. It highlights the potential benefits of these techniques, such as greater alignment with the way natural intelligence works and the possibility of developing more efficient and robust AI systems. However, the paper also acknowledges the significant challenges and limitations of these approaches, underscoring the need for further research and experimentation to determine their practical viability and real-world efficacy. Overall, the paper provides a valuable contribution to the ongoing efforts to bridge the gap between artificial and biological intelligence.

This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

💬

Backpropagation through space, time, and the brain

Benjamin Ellenberger, Paul Haider, Jakob Jordan, Kevin Max, Ismael Jaras, Laura Kriener, Federico Benitez, Mihai A. Petrovici

How physical networks of neurons, bound by spatio-temporal locality constraints, can perform efficient credit assignment, remains, to a large extent, an open question. In machine learning, the answer is almost universally given by the error backpropagation algorithm, through both space and time. However, this algorithm is well-known to rely on biologically implausible assumptions, in particular with respect to spatio-temporal (non-)locality. Alternative forward-propagation models such as real-time recurrent learning only partially solve the locality problem, but only at the cost of scaling, due to prohibitive storage requirements. We introduce Generalized Latent Equilibrium (GLE), a computational framework for fully local spatio-temporal credit assignment in physical, dynamical networks of neurons. We start by defining an energy based on neuron-local mismatches, from which we derive both neuronal dynamics via stationarity and parameter dynamics via gradient descent. The resulting dynamics can be interpreted as a real-time, biologically plausible approximation of backpropagation through space and time in deep cortical networks with continuous-time neuronal dynamics and continuously active, local synaptic plasticity. In particular, GLE exploits the morphology of dendritic trees to enable more complex information storage and processing in single neurons, as well as the ability of biological neurons to phase-shift their output rate with respect to their membrane potential, which is essential in both directions of information propagation. For the forward computation, it enables the mapping of time-continuous inputs to neuronal space, effectively performing a spatio-temporal convolution. For the backward computation, it permits the temporal inversion of feedback signals, which consequently approximate the adjoint variables necessary for useful parameter updates.

7/17/2024

Towards Biologically Plausible Computing: A Comprehensive Comparison

Changze Lv, Yufei Gu, Zhengkang Guo, Zhibo Xu, Yixin Wu, Feiran Zhang, Tianyuan Shi, Zhenghua Wang, Ruicheng Yin, Yu Shang, Siqi Zhong, Xiaohua Wang, Muling Wu, Wenhao Liu, Tianlong Li, Jianhao Zhu, Cenyuan Zhang, Zixuan Ling, Xiaoqing Zheng

Backpropagation is a cornerstone algorithm in training neural networks for supervised learning, which uses a gradient descent method to update network weights by minimizing the discrepancy between actual and desired outputs. Despite its pivotal role in propelling deep learning advancements, the biological plausibility of backpropagation is questioned due to its requirements for weight symmetry, global error computation, and dual-phase training. To address this long-standing challenge, many studies have endeavored to devise biologically plausible training algorithms. However, a fully biologically plausible algorithm for training multilayer neural networks remains elusive, and interpretations of biological plausibility vary among researchers. In this study, we establish criteria for biological plausibility that a desirable learning algorithm should meet. Using these criteria, we evaluate a range of existing algorithms considered to be biologically plausible, including Hebbian learning, spike-timing-dependent plasticity, feedback alignment, target propagation, predictive coding, forward-forward algorithm, perturbation learning, local losses, and energy-based learning. Additionally, we empirically evaluate these algorithms across diverse network architectures and datasets. We compare the feature representations learned by these algorithms with brain activity recorded by non-invasive devices under identical stimuli, aiming to identify which algorithm can most accurately replicate brain activity patterns. We are hopeful that this study could inspire the development of new biologically plausible algorithms for training multilayer networks, thereby fostering progress in both the fields of neuroscience and machine learning.

6/26/2024

📉

Contribute to balance, wire in accordance: Emergence of backpropagation from a simple, bio-plausible neuroplasticity rule

Xinhao Fan, Shreesh P Mysore

Backpropagation (BP) has been pivotal in advancing machine learning and remains essential in computational applications and comparative studies of biological and artificial neural networks. Despite its widespread use, the implementation of BP in the brain remains elusive, and its biological plausibility is often questioned due to inherent issues such as the need for symmetry of weights between forward and backward connections, and the requirement of distinct forward and backward phases of computation. Here, we introduce a novel neuroplasticity rule that offers a potential mechanism for implementing BP in the brain. Similar in general form to the classical Hebbian rule, this rule is based on the core principles of maintaining the balance of excitatory and inhibitory inputs as well as on retrograde signaling, and operates over three progressively slower timescales: neural firing, retrograde signaling, and neural plasticity. We hypothesize that each neuron possesses an internal state, termed credit, in addition to its firing rate. After achieving equilibrium in firing rates, neurons receive credits based on their contribution to the E-I balance of postsynaptic neurons through retrograde signaling. As the network's credit distribution stabilizes, connections from those presynaptic neurons are strengthened that significantly contribute to the balance of postsynaptic neurons. We demonstrate mathematically that our learning rule precisely replicates BP in layered neural networks without any approximations. Simulations on artificial neural networks reveal that this rule induces varying community structures in networks, depending on the learning rate. This simple theoretical framework presents a biologically plausible implementation of BP, with testable assumptions and predictions that may be evaluated through biological experiments.

5/24/2024

Two Tales of Single-Phase Contrastive Hebbian Learning

Rasmus Kj{ae}r H{o}ier, Christopher Zach

The search for ``biologically plausible'' learning algorithms has converged on the idea of representing gradients as activity differences. However, most approaches require a high degree of synchronization (distinct phases during learning) and introduce substantial computational overhead, which raises doubts regarding their biological plausibility as well as their potential utility for neuromorphic computing. Furthermore, they commonly rely on applying infinitesimal perturbations (nudges) to output units, which is impractical in noisy environments. Recently it has been shown that by modelling artificial neurons as dyads with two oppositely nudged compartments, it is possible for a fully local learning algorithm named ``dual propagation'' to bridge the performance gap to backpropagation, without requiring separate learning phases or infinitesimal nudging. However, the algorithm has the drawback that its numerical stability relies on symmetric nudging, which may be restrictive in biological and analog implementations. In this work we first provide a solid foundation for the objective underlying the dual propagation method, which also reveals a surprising connection with adversarial robustness. Second, we demonstrate how dual propagation is related to a particular adjoint state method, which is stable regardless of asymmetric nudging.

6/26/2024