Unsupervised representation learning with Hebbian synaptic and structural plasticity in brain-like feedforward neural networks
2406.04733
0
0
🤷
Abstract
Neural networks that can capture key principles underlying brain computation offer exciting new opportunities for developing artificial intelligence and brain-like computing algorithms. Such networks remain biologically plausible while leveraging localized forms of synaptic learning rules and modular network architecture found in the neocortex. Compared to backprop-driven deep learning approches, they provide more suitable models for deploying on neuromorphic hardware and have greater potential for scalability on large-scale computing clusters. The development of such brain-like neural networks depends on having a learning procedure that can build effective internal representations from data. In this work, we introduce and evaluate a brain-like neural network model capable of unsupervised representation learning. It builds on the Bayesian Confidence Propagation Neural Network (BCPNN), which has earlier been implemented as abstract as well as biophyscially detailed recurrent attractor neural networks explaining various cortical associative memory phenomena. Here we developed a feedforward BCPNN model to perform representation learning by incorporating a range of brain-like attributes derived from neocortical circuits such as cortical columns, divisive normalization, Hebbian synaptic plasticity, structural plasticity, sparse activity, and sparse patchy connectivity. The model was tested on a diverse set of popular machine learning benchmarks: grayscale images (MNIST, Fashion-MNIST), RGB natural images (SVHN, CIFAR-10), QSAR (MUV, HIV), and malware detection (EMBER). The performance of the model when using a linear classifier to predict the class labels fared competitively with conventional multi-layer perceptrons and other state-of-the-art brain-like neural networks.
Create account to get full access
Overview
- Introduces a brain-inspired neural network model capable of unsupervised representation learning
- Builds on the Bayesian Confidence Propagation Neural Network (BCPNN) and incorporates brain-like attributes from neocortical circuits
- Tested on a variety of machine learning benchmarks, achieving competitive performance with linear classifiers
Plain English Explanation
The paper presents a new type of neural network that is inspired by how the brain works. This network is designed to learn useful representations of data [^1] without being told the correct answers ahead of time. It builds on an earlier model called the Bayesian Confidence Propagation Neural Network (BCPNN), which has been used to explain how the brain's cortex stores and recalls memories.
The key innovations in this new model include:
- Incorporating features found in the brain's neocortex, such as cortical columns, divisive normalization, Hebbian synaptic plasticity, structural plasticity, sparse activity, and sparse patchy connectivity
- Using a feedforward architecture, which makes it more suitable for deployment on neuromorphic hardware and scalable on large computing clusters
The model was tested on a variety of common machine learning benchmarks, such as image recognition and drug discovery tasks. Even when using a simple linear classifier on top of the learned representations, the model performed competitively with more complex deep learning approaches.
[^1]: Representation learning refers to the process of automatically discovering the underlying features or patterns in raw data, which can then be used for various tasks like classification, prediction, or understanding.
Technical Explanation
The paper introduces a feedforward version of the Bayesian Confidence Propagation Neural Network (BCPNN) that is capable of unsupervised representation learning. The model incorporates a range of brain-inspired attributes derived from the neocortical circuit, including:
- Cortical columns: The network is organized into modular units analogous to the cortical columns found in the brain's neocortex.
- Divisive normalization: The model uses a divisive normalization operation to introduce competition between neural units and contribute to the emergence of sparse representations.
- Hebbian synaptic plasticity: The network learns through Hebbian learning, where the connections between co-active units are strengthened.
- Structural plasticity: The model can dynamically modify its connectivity structure through the addition and removal of synaptic connections.
- Sparse activity: The network encourages sparse neural activity, similar to the sparse firing patterns observed in the brain.
- Sparse patchy connectivity: The connectivity between the network's layers is characterized by sparse, patchy connections, as seen in the neocortex.
The model was evaluated on a diverse set of machine learning benchmarks, including grayscale images (MNIST, Fashion-MNIST), RGB natural images (SVHN, CIFAR-10), QSAR (MUV, HIV), and malware detection (EMBER). Even when using a simple linear classifier on top of the learned representations, the model's performance was competitive with conventional multi-layer perceptrons and other state-of-the-art brain-inspired neural networks.
Critical Analysis
The paper presents a promising approach to developing brain-inspired neural networks capable of unsupervised representation learning. By incorporating a range of biologically plausible attributes, the model aims to capture key principles underlying brain computation and offer new opportunities for artificial intelligence and neuromorphic computing.
One potential limitation is that the evaluation was primarily focused on standard machine learning benchmarks, which may not fully capture the model's ability to learn representations that are truly analogous to how the brain processes information. Further testing on more naturalistic, open-ended tasks could provide additional insights into the model's capabilities.
Additionally, the paper does not delve deeply into the computational and biological mechanisms underlying the model's performance. A more thorough analysis of the network's internal dynamics and the role of specific architectural features could shed light on the model's strengths, weaknesses, and potential for further improvements.
Nonetheless, the development of brain-inspired neural networks that can effectively learn representations from data [^1] is an exciting area of research with significant implications for the field of artificial intelligence. This work contributes to the growing body of knowledge in this domain and encourages further exploration of biologically plausible approaches to machine learning.
[^1]: Representation learning refers to the process of automatically discovering the underlying features or patterns in raw data, which can then be used for various tasks like classification, prediction, or understanding.
Conclusion
The paper presents a feedforward neural network model inspired by the brain's neocortical circuits, which is capable of unsupervised representation learning. By incorporating a range of biologically plausible attributes, such as cortical columns, divisive normalization, Hebbian synaptic plasticity, and sparse connectivity, the model demonstrates competitive performance on various machine learning benchmarks.
This work highlights the potential of brain-inspired neural networks to offer new opportunities for developing artificial intelligence and brain-like computing algorithms. The model's ability to learn effective internal representations from data, while remaining biologically plausible, could have significant implications for the field of neuromorphic computing and the advancement of artificial intelligence systems that are more aligned with the principles of biological intelligence.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
📉
Spiking representation learning for associative memories
Naresh Ravichandran, Anders Lansner, Pawel Herman
0
0
Networks of interconnected neurons communicating through spiking signals offer the bedrock of neural computations. Our brains spiking neural networks have the computational capacity to achieve complex pattern recognition and cognitive functions effortlessly. However, solving real-world problems with artificial spiking neural networks (SNNs) has proved to be difficult for a variety of reasons. Crucially, scaling SNNs to large networks and processing large-scale real-world datasets have been challenging, especially when compared to their non-spiking deep learning counterparts. The critical operation that is needed of SNNs is the ability to learn distributed representations from data and use these representations for perceptual, cognitive and memory operations. In this work, we introduce a novel SNN that performs unsupervised representation learning and associative memory operations leveraging Hebbian synaptic and activity-dependent structural plasticity coupled with neuron-units modelled as Poisson spike generators with sparse firing (~1 Hz mean and ~100 Hz maximum firing rate). Crucially, the architecture of our model derives from the neocortical columnar organization and combines feedforward projections for learning hidden representations and recurrent projections for forming associative memories. We evaluated the model on properties relevant for attractor-based associative memories such as pattern completion, perceptual rivalry, distortion resistance, and prototype extraction.
6/6/2024
📉
Neuron-centric Hebbian Learning
Andrea Ferigo, Elia Cunegatti, Giovanni Iacca
0
0
One of the most striking capabilities behind the learning mechanisms of the brain is the adaptation, through structural and functional plasticity, of its synapses. While synapses have the fundamental role of transmitting information across the brain, several studies show that it is the neuron activations that produce changes on synapses. Yet, most plasticity models devised for artificial Neural Networks (NNs), e.g., the ABCD rule, focus on synapses, rather than neurons, therefore optimizing synaptic-specific Hebbian parameters. This approach, however, increases the complexity of the optimization process since each synapse is associated to multiple Hebbian parameters. To overcome this limitation, we propose a novel plasticity model, called Neuron-centric Hebbian Learning (NcHL), where optimization focuses on neuron- rather than synaptic-specific Hebbian parameters. Compared to the ABCD rule, NcHL reduces the parameters from $5W$ to $5N$, being $W$ and $N$ the number of weights and neurons, and usually $N ll W$. We also devise a ``weightless'' NcHL model, which requires less memory by approximating the weights based on a record of neuron activations. Our experiments on two robotic locomotion tasks reveal that NcHL performs comparably to the ABCD rule, despite using up to $sim97$ times less parameters, thus allowing for scalable plasticity
4/17/2024
Evolving Self-Assembling Neural Networks: From Spontaneous Activity to Experience-Dependent Learning
Erwan Plantec, Joachin W. Pedersen, Milton L. Montero, Eleni Nisioti, Sebastian Risi
0
0
Biological neural networks are characterized by their high degree of plasticity, a core property that enables the remarkable adaptability of natural organisms. Importantly, this ability affects both the synaptic strength and the topology of the nervous systems. Artificial neural networks, on the other hand, have been mainly designed as static, fully connected structures that can be notoriously brittle in the face of changing environments and novel inputs. Building on previous works on Neural Developmental Programs (NDPs), we propose a class of self-organizing neural networks capable of synaptic and structural plasticity in an activity and reward-dependent manner which we call Lifelong Neural Developmental Program (LNDP). We present an instance of such a network built on the graph transformer architecture and propose a mechanism for pre-experience plasticity based on the spontaneous activity of sensory neurons. Our results demonstrate the ability of the model to learn from experiences in different control tasks starting from randomly connected or empty networks. We further show that structural plasticity is advantageous in environments necessitating fast adaptation or with non-stationary rewards.
6/17/2024
📉
Contribute to balance, wire in accordance: Emergence of backpropagation from a simple, bio-plausible neuroplasticity rule
Xinhao Fan, Shreesh P Mysore
0
0
Backpropagation (BP) has been pivotal in advancing machine learning and remains essential in computational applications and comparative studies of biological and artificial neural networks. Despite its widespread use, the implementation of BP in the brain remains elusive, and its biological plausibility is often questioned due to inherent issues such as the need for symmetry of weights between forward and backward connections, and the requirement of distinct forward and backward phases of computation. Here, we introduce a novel neuroplasticity rule that offers a potential mechanism for implementing BP in the brain. Similar in general form to the classical Hebbian rule, this rule is based on the core principles of maintaining the balance of excitatory and inhibitory inputs as well as on retrograde signaling, and operates over three progressively slower timescales: neural firing, retrograde signaling, and neural plasticity. We hypothesize that each neuron possesses an internal state, termed credit, in addition to its firing rate. After achieving equilibrium in firing rates, neurons receive credits based on their contribution to the E-I balance of postsynaptic neurons through retrograde signaling. As the network's credit distribution stabilizes, connections from those presynaptic neurons are strengthened that significantly contribute to the balance of postsynaptic neurons. We demonstrate mathematically that our learning rule precisely replicates BP in layered neural networks without any approximations. Simulations on artificial neural networks reveal that this rule induces varying community structures in networks, depending on the learning rate. This simple theoretical framework presents a biologically plausible implementation of BP, with testable assumptions and predictions that may be evaluated through biological experiments.
5/24/2024