From Manifestations to Cognitive Architectures: a Scalable Framework
2406.09823
0
0
Abstract
The Artificial Intelligence field is flooded with optimisation methods. In this paper, we change the focus to developing modelling methods with the aim of getting us closer to Artificial General Intelligence. To do so, we propose a novel way to interpret reality as an information source, that is later translated into a computational framework able to capture and represent such information. This framework is able to build elements of classical cognitive architectures, like Long Term Memory and Working Memory, starting from a simple primitive that only processes Spatial Distributed Representations. Moreover, it achieves such level of verticality in a seamless scalable hierarchical way.
Create account to get full access
Overview
- Presents a computational framework for modeling cognitive processes and architectures
- Introduces a scalable approach to building intelligent systems based on hierarchical abstractions and primitive-based models
- Explores the relationship between manifestations of intelligence and the underlying cognitive architectures
Plain English Explanation
This paper proposes a new way to think about building intelligent systems, or cognitive architectures. Rather than trying to mimic human intelligence directly, the authors suggest starting with simple building blocks or "primitives" and then combining them in hierarchical ways to create more complex cognitive capabilities.
The key idea is that by breaking down intelligence into smaller, reusable components, we can create scalable systems that are more flexible and easier to understand than traditional approaches. This primitive-based modeling allows the system to build up representations and capabilities in a modular fashion, similar to how the human brain is thought to develop.
The paper also explores how these underlying cognitive architectures can give rise to different "manifestations" of intelligence, such as language, reasoning, or perception. By studying the connections between the primitive building blocks and the higher-level behaviors they enable, the authors hope to gain insights into the nature of intelligence and how it can be effectively engineered.
Technical Explanation
The paper proposes a computational framework for modeling cognitive architectures that is based on hierarchical abstractions and primitive-based models. The core idea is to decompose intelligent systems into a set of fundamental building blocks or "primitives" that can be combined in various ways to create more complex cognitive capabilities.
At the lowest level, these primitives represent basic information processing units or operations. By organizing these primitives into hierarchical structures, the framework allows for the representation of increasingly sophisticated representations and multi-modal processing.
The authors argue that this approach is more scalable and flexible than traditional monolithic models of cognition. By breaking down intelligence into modular components, the framework enables the construction of cognitive architectures that can adapt and evolve over time, rather than being constrained by a fixed set of rules or algorithms.
The paper explores how this computational framework can be used to study the relationship between the underlying cognitive architecture and the observable "manifestations" of intelligence, such as language, reasoning, or perception. By analyzing how the primitive-based models give rise to these higher-level cognitive capabilities, the authors aim to gain insights into the nature of intelligence and how it can be effectively engineered.
Critical Analysis
The paper presents a promising approach to modeling cognitive architectures, but there are a few potential limitations and areas for further exploration:
- The specific implementation of the primitive-based models and hierarchical abstractions is not fully detailed, making it difficult to assess the practical feasibility of the framework.
- The authors do not provide extensive empirical validation of the framework's ability to capture the complexity of human cognition, which would be necessary to demonstrate its utility.
- The connections between the underlying cognitive architecture and the observable manifestations of intelligence are not yet well-established, requiring further research to clarify these relationships.
Despite these caveats, the core idea of leveraging modular, primitive-based models to build scalable and flexible cognitive architectures is compelling. Continued work in this direction could lead to important advancements in our understanding of intelligence and how it can be effectively engineered.
Conclusion
This paper introduces a novel computational framework for modeling cognitive architectures based on hierarchical abstractions and primitive-based models. By decomposing intelligence into reusable building blocks and organizing them in scalable, modular structures, the authors propose a path towards more flexible and adaptable intelligent systems.
The framework's focus on studying the connections between the underlying cognitive architecture and the observable manifestations of intelligence could yield valuable insights into the nature of intelligence and how it can be effectively engineered. While further research is needed to validate and refine the approach, the paper presents an intriguing new perspective on the challenges of creating artificial general intelligence.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Scalable Artificial Intelligence for Science: Perspectives, Methods and Exemplars
Wesley Brewer, Aditya Kashi, Sajal Dash, Aristeidis Tsaris, Junqi Yin, Mallikarjun Shankar, Feiyi Wang
0
0
In a post-ChatGPT world, this paper explores the potential of leveraging scalable artificial intelligence for scientific discovery. We propose that scaling up artificial intelligence on high-performance computing platforms is essential to address such complex problems. This perspective focuses on scientific use cases like cognitive simulations, large language models for scientific inquiry, medical image analysis, and physics-informed approaches. The study outlines the methodologies needed to address such challenges at scale on supercomputers or the cloud and provides exemplars of such approaches applied to solve a variety of scientific problems.
6/27/2024
🤖
A call for embodied AI
Giuseppe Paolo, Jonas Gonzalez-Billandon, Bal'azs K'egl
0
0
We propose Embodied AI as the next fundamental step in the pursuit of Artificial General Intelligence, juxtaposing it against current AI advancements, particularly Large Language Models. We traverse the evolution of the embodiment concept across diverse fields - philosophy, psychology, neuroscience, and robotics - to highlight how EAI distinguishes itself from the classical paradigm of static learning. By broadening the scope of Embodied AI, we introduce a theoretical framework based on cognitive architectures, emphasizing perception, action, memory, and learning as essential components of an embodied agent. This framework is aligned with Friston's active inference principle, offering a comprehensive approach to EAI development. Despite the progress made in the field of AI, substantial challenges, such as the formulation of a novel AI learning theory and the innovation of advanced hardware, persist. Our discussion lays down a foundational guideline for future Embodied AI research. Highlighting the importance of creating Embodied AI agents capable of seamless communication, collaboration, and coexistence with humans and other intelligent entities within real-world environments, we aim to steer the AI community towards addressing the multifaceted challenges and seizing the opportunities that lie ahead in the quest for AGI.
5/29/2024
🔎
A social path to human-like artificial intelligence
Edgar A. Du'e~nez-Guzm'an, Suzanne Sadedin, Jane X. Wang, Kevin R. McKee, Joel Z. Leibo
0
0
Traditionally, cognitive and computer scientists have viewed intelligence solipsistically, as a property of unitary agents devoid of social context. Given the success of contemporary learning algorithms, we argue that the bottleneck in artificial intelligence (AI) progress is shifting from data assimilation to novel data generation. We bring together evidence showing that natural intelligence emerges at multiple scales in networks of interacting agents via collective living, social relationships and major evolutionary transitions, which contribute to novel data generation through mechanisms such as population pressures, arms races, Machiavellian selection, social learning and cumulative culture. Many breakthroughs in AI exploit some of these processes, from multi-agent structures enabling algorithms to master complex games like Capture-The-Flag and StarCraft II, to strategic communication in Diplomacy and the shaping of AI data streams by other AIs. Moving beyond a solipsistic view of agency to integrate these mechanisms suggests a path to human-like compounding innovation through ongoing novel data generation.
5/28/2024
Representations as Language: An Information-Theoretic Framework for Interpretability
Henry Conklin, Kenny Smith
0
0
Large scale neural models show impressive performance across a wide array of linguistic tasks. Despite this they remain, largely, black-boxes - inducing vector-representations of their input that prove difficult to interpret. This limits our ability to understand what they learn, and when the learn it, or describe what kinds of representations generalise well out of distribution. To address this we introduce a novel approach to interpretability that looks at the mapping a model learns from sentences to representations as a kind of language in its own right. In doing so we introduce a set of information-theoretic measures that quantify how structured a model's representations are with respect to its input, and when during training that structure arises. Our measures are fast to compute, grounded in linguistic theory, and can predict which models will generalise best based on their representations. We use these measures to describe two distinct phases of training a transformer: an initial phase of in-distribution learning which reduces task loss, then a second stage where representations becoming robust to noise. Generalisation performance begins to increase during this second phase, drawing a link between generalisation and robustness to noise. Finally we look at how model size affects the structure of the representational space, showing that larger models ultimately compress their representations more than their smaller counterparts.
6/5/2024