Assembling Modular, Hierarchical Cognitive Map Learners with Hyperdimensional Computing

Read original: arXiv:2404.19051 - Published 5/1/2024 by Nathan McDonald, Anthony Dematteo

🧠

Overview

Cognitive map learners (CMLs) are a type of neural network that can navigate abstract graphs and perform near-optimal path planning.
CMLs learn internal representations of node states, edge actions, and edge action availabilities, but do not learn when or why to transition between nodes.
This work created CMLs that use high-dimensional vectors consistent with hyperdimensional computing (HDC), a form of symbolic machine learning (ML).
The HDC-based CMLs were evaluated as ML modules that can receive external inputs and compute semantically meaningful output responses for other HDC-based modules.
Several CMLs were repurposed to solve the Tower of Hanoi puzzle without retraining or explicit reference to their graph topologies, suggesting a template for building levels of biologically plausible cognitive abstraction and orchestration.

Plain English Explanation

Cognitive map learners (CMLs) are a type of artificial neural network that can navigate through abstract graphs, like a maze or a puzzle. These networks learn internal representations of the different states of the nodes (or locations) in the graph, the actions they can take to move between nodes, and which actions are available at each node.

The key feature of CMLs is that they can plan the optimal path between any two nodes in the graph. This means they can find the shortest or most efficient route to get from one location to another. However, CMLs don't actually learn when or why they should move from one node to another. They just focus on learning the internal map of the graph.

In this work, the researchers created CMLs that use [object Object], a type of [object Object]. This allowed the CMLs to represent the node states and other information as high-dimensional vectors, which can be processed in a modular and semantically meaningful way.

The researchers then took these HDC-based CMLs and showed that they could be repurposed to solve the Tower of Hanoi puzzle, without having to retrain the networks or explicitly program their knowledge of the puzzle's graph topology. This suggests that CMLs could be used as building blocks to create more complex, hierarchical cognitive systems that can adapt to different tasks and environments.

Technical Explanation

The core of this work is the [object Object], which is a collection of separate yet collaboratively trained single-layer artificial neural networks (matrices). These CMLs can navigate an abstract graph by learning internal representations of the node states, edge actions, and edge action availabilities.

The researchers created CMLs that represent the node states as high-dimensional vectors, consistent with the principles of [object Object], a form of [object Object]. This allows the CMLs to be evaluated as modular ML components that can receive external inputs and compute semantically meaningful output responses for other HDC-based modules.

The key finding is that several independently prepared CMLs could be repurposed to solve the Tower of Hanoi puzzle without requiring retraining or explicit knowledge of the puzzle's graph topology. This suggests that CMLs could be used as a template for building hierarchical cognitive systems that can adapt to different tasks and environments, as seen in [object Object] and [object Object].

Critical Analysis

The paper presents an interesting approach to building modular and adaptable cognitive systems using CMLs. However, there are a few potential limitations and areas for further research:

Scalability: The paper demonstrates the CMLs' ability to solve the Tower of Hanoi puzzle, but it's unclear how well the approach would scale to more complex and realistic problem domains. Further research is needed to assess the CMLs' performance on larger and more diverse graph structures.
Learning Mechanisms: The paper does not go into detail about how the CMLs learn their internal representations of the node states, edge actions, and edge action availabilities. More information on the learning algorithms and the factors that influence their performance would be valuable.
Transition Learning: A key limitation of the current CMLs is that they do not learn when or why to transition from one node to another. Developing mechanisms for learning these higher-level cognitive processes could further enhance the CMLs' capabilities and adaptability.
Biological Plausibility: While the paper suggests that CMLs could serve as a template for building biologically plausible cognitive systems, more work is needed to establish a clearer connection between the CML architecture and the underlying neurological mechanisms that govern human cognition and decision-making.

Overall, the paper presents a promising approach to modular and adaptable machine learning, but further research is needed to address the limitations and fully realize the potential of CMLs as building blocks for more sophisticated cognitive systems.

Conclusion

This work on cognitive map learners (CMLs) demonstrates a novel approach to building modular and adaptable machine learning systems. By using high-dimensional vector representations consistent with hyperdimensional computing (HDC) and symbolic machine learning (ML), the researchers were able to create CMLs that can perform near-optimal path planning in abstract graphs, while also being repurposed to solve complex puzzles like the Tower of Hanoi.

The ability to reuse and recombine these CMLs without retraining suggests a promising template for building hierarchical cognitive systems that can adapt to different tasks and environments. This work could have significant implications for the development of more robust and versatile artificial intelligence systems, as well as for our understanding of the underlying mechanisms of human cognition and decision-making.

This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🧠

Assembling Modular, Hierarchical Cognitive Map Learners with Hyperdimensional Computing

Nathan McDonald, Anthony Dematteo

Cognitive map learners (CML) are a collection of separate yet collaboratively trained single-layer artificial neural networks (matrices), which navigate an abstract graph by learning internal representations of the node states, edge actions, and edge action availabilities. A consequence of this atypical segregation of information is that the CML performs near-optimal path planning between any two graph node states. However, the CML does not learn when or why to transition from one node to another. This work created CMLs with node states expressed as high dimensional vectors consistent with hyperdimensional computing (HDC), a form of symbolic machine learning (ML). This work evaluated HDC-based CMLs as ML modules, capable of receiving external inputs and computing output responses which are semantically meaningful for other HDC-based modules. Several CMLs were prepared independently then repurposed to solve the Tower of Hanoi puzzle without retraining these CMLs and without explicit reference to their respective graph topologies. This work suggests a template for building levels of biologically plausible cognitive abstraction and orchestration.

5/1/2024

📶

Modular, Hierarchical Machine Learning for Sequential Goal Completion

Nathan McDonald

Given a maze populated with different objects, one may task a robot with a sequential goal completion task, e.g. 1) pick up a key then 2) unlock the door then 3) unlock the treasure chest. A typical machine learning (ML) solution would involve a monolithically trained artificial neural network (ANN). However, if the sequence of goals or the goals themselves change, then the ANN must be significantly (or, at worst, completely) retrained. Instead of a monolithic ANN, a modular ML component would be 1) independently optimizable (task-agnostic) and 2) arbitrarily reconfigurable with other ML modules. This work describes a modular, hierarchical ML framework by integrating two emerging ML techniques: 1) cognitive map learners (CML) and 2) hyperdimensional computing (HDC). A CML is a collection of three single layer ANNs (matrices) collaboratively trained to learn the topology of an abstract graph. Here, two CMLs were constructed, one describing locations on in 2D physical space and the other the relative distribution of objects found in this space. Each CML node states was encoded as a high-dimensional vector to utilize HDC, an ML algebra, for symbolic reasoning over these high-dimensional symbol vectors. In this way, each sub-goal above was described by algebraic equations of CML node states. Multiple, independently trained CMLs were subsequently assembled together to navigate a maze to solve a sequential goal task. Critically, changes to these goals required only localized changes in the CML-HDC architecture, as opposed to a global ANN retraining scheme. This framework therefore enabled a more traditional engineering approach to ML, akin to digital logic design.

5/1/2024

Hyperdimensional Computing for Node Classification and Link Prediction

Abhishek Dalvi, Vasant Honavar

We introduce a novel method for transductive learning on graphs using hyperdimensional representations. The proposed approach encodes data samples using random projections into a very high-dimensional space (hyperdimensional or HD space for short). It obviates the need for expensive iterative training of the sort required by deep learning methods. Specifically, we propose a Hyperdimensional Graph Learning (HDGL) algorithm. HDGL leverages the emph{injectivity} property of node representations of a family of Graph Neural Networks (GNNs) to map node features to the HD space and then uses HD operators such as bundling and binding to aggregate information from the local neighborhood of each node. The resulting latent node representations support both node classification and link prediction tasks, unlike typical deep learning methods, which often require separate models for these tasks. We report results of experiments using widely used benchmark datasets which demonstrate that, on the node classification task, HDGL is competitive with the SOTA GNN methods with respect to accuracy, at substantially reduced computational cost. Furthermore, HDGL is well-suited for class incremental learning where the model has to learn to effectively discriminate between a growing number of classes. Our experiments also show that the HD representation constructed by HDGL supports link prediction at accuracies comparable to that of DeepWalk and related methods, although it falls short of SOTA Graph Neural Network (GNN) methods that rely on computationally expensive iterative training. We conclude that HDGL offers a computationally efficient alternative to graph neural networks for node classification, especially in settings that call for class-incremental learning or in applications that demand high accuracy models at significantly lower computational cost and learning time than possible with the SOTA GNNs.

7/23/2024

New!Hierarchical Hypercomplex Network for Multimodal Emotion Recognition

Eleonora Lopez, Aurelio Uncini, Danilo Comminiello

Emotion recognition is relevant in various domains, ranging from healthcare to human-computer interaction. Physiological signals, being beyond voluntary control, offer reliable information for this purpose, unlike speech and facial expressions which can be controlled at will. They reflect genuine emotional responses, devoid of conscious manipulation, thereby enhancing the credibility of emotion recognition systems. Nonetheless, multimodal emotion recognition with deep learning models remains a relatively unexplored field. In this paper, we introduce a fully hypercomplex network with a hierarchical learning structure to fully capture correlations. Specifically, at the encoder level, the model learns intra-modal relations among the different channels of each input signal. Then, a hypercomplex fusion module learns inter-modal relations among the embeddings of the different modalities. The main novelty is in exploiting intra-modal relations by endowing the encoders with parameterized hypercomplex convolutions (PHCs) that thanks to hypercomplex algebra can capture inter-channel interactions within single modalities. Instead, the fusion module comprises parameterized hypercomplex multiplications (PHMs) that can model inter-modal correlations. The proposed architecture surpasses state-of-the-art models on the MAHNOB-HCI dataset for emotion recognition, specifically in classifying valence and arousal from electroencephalograms (EEGs) and peripheral physiological signals. The code of this study is available at https://github.com/ispamm/MHyEEG.

9/17/2024