Meat Meets Machine! Multiscale Competency Enables Causal Learning
0
👀
Sign in to get full access
Overview
- Biological intelligence exhibits adaptive, goal-directed behavior at all scales, from cells to organs to organisms, while machine intelligence is only adaptive and goal-directed at a high level.
- Biological intelligence excels at causal learning, which is hindered in machine intelligence due to the use of pre-defined abstractions (e.g., arithmetic) embodied in static interpreters (e.g., x86).
- The paper formalizes biological intelligence as a Multiscale Competency Architecture (MCA), where nested agentic abstraction layers enable multiscale causal learning and high-level goal-directed behavior.
Plain English Explanation
Biological systems, like our own brains and bodies, are incredibly complex and adaptive. They can learn and respond to their environment in sophisticated ways, adjusting their behavior at all scales, from the individual cells to the entire organism. In contrast, current machine intelligence is only truly adaptive and goal-directed at a high level, relying on pre-defined abstractions and static interpreters to passively process information.
The key difference is that biological intelligence is exceptionally good at causal learning - understanding the underlying mechanisms and causes behind the things it observes. This allows it to flexibly adapt and respond to new situations. Machine intelligence, on the other hand, struggles with causal learning because it is constrained by the abstractions and frameworks we've imposed on it, like mathematical operations and programming languages.
The researchers propose that biological intelligence can be understood as a Multiscale Competency Architecture (MCA), where there are nested layers of adaptive, goal-directed behavior. At the lowest levels, weak policy optimization (i.e., simple trial-and-error learning) enables higher-level competencies and causal understanding to emerge. This multiscale causal learning is what gives rise to the flexible, intelligent behaviors we see in living things.
In contrast, by encoding human-designed abstractions directly into machine intelligence (like the arithmetic and logic of computer processors), we may be inadvertently disconnecting the high-level goal-directed behavior from the low-level adaptive mechanisms that gave rise to it in biological systems. This could be one reason why machine recall and reasoning often lacks the feeling and meaning that accompanies human cognition.
Technical Explanation
The paper proposes that biological intelligence uses a Multiscale Competency Architecture (MCA), where adaptive, goal-directed behavior emerges at all scales, from cells to organs to organisms. This is in contrast to machine intelligence, which is only adaptive and goal-directed at a high level.
The authors argue that biological intelligence excels at causal learning, while machine intelligence struggles with this due to the use of pre-defined abstractions (e.g., arithmetic) embodied in static interpreters (e.g., x86 processors). Previous work has shown that causal learning follows from weak policy optimization, which is hindered by these pre-supposed abstractions.
To understand how biological MCAs might enable causal learning, the researchers formalize them as nested agentic abstraction layers. They show that weak policy optimization at low levels enables weak policy optimization at higher levels, facilitating what they call multiscale causal learning and high-level goal-directed behavior.
The paper argues that by engineering human abstractions directly into machine intelligence (like the computational dualism of hardware and software), we may be disconnecting high-level goal-directed behavior from the low-level adaptive mechanisms that gave rise to it in biological systems. This, the authors speculate, could be one reason why human recall is accompanied by feeling and meaning, while machine recall is not.
Critical Analysis
The paper presents a thought-provoking perspective on the differences between biological and machine intelligence, and how the engineering of human abstractions into machine systems may be inhibiting the development of causal learning capabilities.
One potential limitation is that the formalization of MCAs and the mechanisms of multiscale causal learning are not fully developed or empirically validated in the paper. The authors acknowledge this and suggest that further research is needed to test their hypotheses and explore the specific architectural and learning principles that enable biological intelligence to excel at causal reasoning.
Additionally, the paper does not address the potential challenges of engineering machine intelligence systems that can truly emulate the flexibility and adaptability of biological cognition. Replicating the multi-scale, nested competencies of living systems in artificial constructs may require fundamental breakthroughs in our approaches to machine learning and computational architectures.
Overall, the paper raises important questions about the nature of intelligence and the limitations of current machine learning techniques. By highlighting the significance of causal learning and the potential downsides of over-engineering human abstractions into artificial systems, it encourages readers to think critically about the future of artificial intelligence and its relationship to biological cognition.
Conclusion
This paper proposes that the key difference between biological and machine intelligence lies in their respective approaches to causal learning and goal-directed behavior. Biological systems exhibit adaptive, goal-directed competencies at multiple scales, from cells to organisms, enabling them to excel at understanding the underlying causes and mechanisms in their environments.
In contrast, current machine intelligence is predominantly adaptive and goal-directed only at a high level, relying on pre-defined abstractions and static interpreters that hinder causal learning. The researchers argue that by formalizing biological intelligence as a Multiscale Competency Architecture (MCA), we can better understand how nested layers of adaptive, goal-directed behavior enable multiscale causal learning and flexible, intelligent behaviors.
The authors suggest that the engineering of human abstractions directly into machine intelligence may be disconnecting high-level goal-directed behavior from the low-level adaptive mechanisms that gave rise to it in biological systems. This could be one reason why machine recall and reasoning often lacks the feeling and meaning that accompanies human cognition.
Overall, this paper encourages a deeper exploration of the fundamental differences between biological and machine intelligence, with the goal of developing artificial systems that can more effectively learn about and adapt to the causal structure of the world.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
👀
0
Meat Meets Machine! Multiscale Competency Enables Causal Learning
Michael Timothy Bennett
Biological intelligence is more sample-efficient than artificial intelligence (AI), learning from fewer examples. Here we answer why. Given data, there can be many policies which seem correct because they perfectly fit the data. However, only one correct policy could have actually caused the data. Sample-efficiency requires a means of discerning which. Previous work showed sample efficiency is maximised by weak-policy-optimisation (WPO); preferring policies that more weakly constrain what is considered to be correct, given finite resources. Biology's sample-efficiency demonstrates it is better at WPO. To understand how, we formalise the multiscale-competency-architecture (MCA) observed in biological systems, as a sequence of nested agentic-abstraction-layers. We show that WPO at low levels enables synthesis of weaker policies at high. We call this multiscale-causal-learning, and argue this is how we might construct more scale-able, sample-efficient and reliable AI. Furthermore, a sufficiently weak policy at low levels is a precondition of collective policy at higher levels. The higher level identity of the collective is lost if lower levels use an insufficiently weak policy (e.g. cells may become isolated from the collective informational structure and revert to primitive behaviour). This has implications for biology, machine learning, AI-safety, and philosophy.
Read more6/4/2024
🌐
0
Disentangled Representations for Causal Cognition
Filippo Torresan, Manuel Baltieri
Complex adaptive agents consistently achieve their goals by solving problems that seem to require an understanding of causal information, information pertaining to the causal relationships that exist among elements of combined agent-environment systems. Causal cognition studies and describes the main characteristics of causal learning and reasoning in human and non-human animals, offering a conceptual framework to discuss cognitive performances based on the level of apparent causal understanding of a task. Despite the use of formal intervention-based models of causality, including causal Bayesian networks, psychological and behavioural research on causal cognition does not yet offer a computational account that operationalises how agents acquire a causal understanding of the world. Machine and reinforcement learning research on causality, especially involving disentanglement as a candidate process to build causal representations, represent on the one hand a concrete attempt at designing causal artificial agents that can shed light on the inner workings of natural causal cognition. In this work, we connect these two areas of research to build a unifying framework for causal cognition that will offer a computational perspective on studies of animal cognition, and provide insights in the development of new algorithms for causal reinforcement learning in AI.
Read more7/2/2024
💬
0
Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability
Atticus Geiger, Duligur Ibeling, Amir Zur, Maheep Chaudhary, Sonakshi Chauhan, Jing Huang, Aryaman Arora, Zhengxuan Wu, Noah Goodman, Christopher Potts, Thomas Icard
Causal abstraction provides a theoretical foundation for mechanistic interpretability, the field concerned with providing intelligible algorithms that are faithful simplifications of the known, but opaque low-level details of black box AI models. Our contributions are (1) generalizing the theory of causal abstraction from mechanism replacement (i.e., hard and soft interventions) to arbitrary mechanism transformation (i.e., functionals from old mechanisms to new mechanisms), (2) providing a flexible, yet precise formalization for the core concepts of modular features, polysemantic neurons, and graded faithfulness, and (3) unifying a variety of mechanistic interpretability methodologies in the common language of causal abstraction, namely activation and path patching, causal mediation analysis, causal scrubbing, causal tracing, circuit analysis, concept erasure, sparse autoencoders, differential binary masking, distributed alignment search, and activation steering.
Read more7/9/2024
0
AI-driven multi-omics integration for multi-scale predictive modeling of causal genotype-environment-phenotype relationships
You Wu (Ph.D. Program in Computer Science, The Graduate Center, The City University of New York, New York, New York, USA), Lei Xie (Ph.D. Program in Computer Science, The Graduate Center, The City University of New York, New York, New York, USA, Ph.D. Program in Biology and Biochemistry, The Graduate Center, The City University of New York, New York, New York, USA, Department of Computer Science, Hunter College, The City University of New York, New York, New York, USA, Helen and Robert Appel Alzheimers Disease Research Institute, Feil Family Brain and Mind Research Institute, Weill Cornell Medicine, Cornell University, New York, New York, USA)
Despite the wealth of single-cell multi-omics data, it remains challenging to predict the consequences of novel genetic and chemical perturbations in the human body. It requires knowledge of molecular interactions at all biological levels, encompassing disease models and humans. Current machine learning methods primarily establish statistical correlations between genotypes and phenotypes but struggle to identify physiologically significant causal factors, limiting their predictive power. Key challenges in predictive modeling include scarcity of labeled data, generalization across different domains, and disentangling causation from correlation. In light of recent advances in multi-omics data integration, we propose a new artificial intelligence (AI)-powered biology-inspired multi-scale modeling framework to tackle these issues. This framework will integrate multi-omics data across biological levels, organism hierarchies, and species to predict causal genotype-environment-phenotype relationships under various conditions. AI models inspired by biology may identify novel molecular targets, biomarkers, pharmaceutical agents, and personalized medicines for presently unmet medical needs.
Read more7/10/2024