Oxygen vacancies modulated VO2 for neurons and Spiking Neural Network construction
0
๐ง
Sign in to get full access
Overview
- Artificial neuronal devices are crucial components for neuromorphic computing systems that aim to emulate the brain's functionality.
- Vanadium Dioxide (VO2) has been considered a promising material for neuronal device fabrication due to its insulator-metal phase transition, but its high power consumption and low operating frequency have been limitations.
- This study addresses these challenges by preparing oxygen vacancies-modulated VO2 (VO2-x) films and fabricating VO2-x neuronal devices for Spiking Neural Networks (SNNs) construction.
Plain English Explanation
The human brain is an incredibly complex and efficient computing system, and researchers are working to recreate its capabilities using artificial neuronal devices. These devices are the building blocks of neuromorphic computing systems, which are designed to mimic the brain's neural networks and information processing.
One material that has shown promise for these neuronal devices is Vanadium Dioxide (VO2). VO2 can switch between an insulating state and a metallic state, which is similar to how neurons in the brain fire and transmit information. However, the VO2 neuronal devices developed so far have had some limitations, including high power consumption and low operating speed.
In this study, the researchers addressed these challenges by creating a modified version of VO2 called VO2-x, which has oxygen vacancies (missing oxygen atoms) in the material. This change allowed the VO2-x neuronal devices to operate at lower voltages and higher speeds, making them more suitable for practical applications.
The researchers then used these VO2-x neuronal devices to build a Spiking Neural Network (SNN) system, which is a type of artificial neural network that mimics the way the brain's neurons fire and transmit information. They trained this SNN system using the MNIST dataset, a well-known dataset of handwritten digits, and found that it demonstrated excellent accuracy in image recognition tasks.
This research not only shows the potential of VO2-x based neuronal devices and SNN systems for practical applications, but it also offers a strategy for optimizing future neuromorphic computing systems through "defect engineering" - purposefully introducing small imperfections or defects in the materials to improve their performance.
Technical Explanation
The researchers in this study aimed to address the limitations of previous VO2 neuronal devices, which required high bias voltages to operate and consequently had high power consumption and low processing speeds.
To overcome these challenges, the researchers prepared VO2-x films with oxygen vacancies and fabricated VO2-x neuronal devices. The presence of oxygen vacancies in the VO2-x material allowed the devices to operate at lower voltages while maintaining high efficiency and stability.
The researchers then used these VO2-x neuronal devices to construct a Spiking Neural Network (SNN) system, which is a type of artificial neural network that mimics the way the brain's neurons fire and transmit information. They trained this BP-SNN system using the MNIST dataset and found that it demonstrated excellent accuracy in image recognition tasks.
The researchers' approach of using oxygen vacancies-modulated VO2-x films to fabricate neuronal devices represents a significant advancement in the field of neuromorphic computing. By addressing the limitations of previous VO2 devices, this study paves the way for the development of more efficient and practical neuromorphic computing systems that can better emulate the brain's functionality.
Critical Analysis
The researchers in this study have made a valuable contribution to the field of neuromorphic computing by addressing the key limitations of previous VO2 neuronal devices. The use of oxygen vacancies-modulated VO2-x films to fabricate neuronal devices with improved performance is a clever and promising approach.
However, the paper does not provide much detail on the specific mechanisms underlying the improved performance of the VO2-x devices, such as the precise role of the oxygen vacancies or the impact on the insulator-metal phase transition. Additionally, the paper does not discuss the long-term stability and reliability of the VO2-x neuronal devices, which would be crucial for their practical implementation.
Furthermore, while the researchers demonstrate the effectiveness of the VO2-x based Spiking Neural Network system in image recognition tasks, it would be valuable to see how the system performs on a wider range of applications and datasets to better assess its versatility and scalability.
Overall, this study represents an important step forward in the development of neuromorphic computing systems, and the researchers' approach to defect engineering offers a promising direction for future optimization and improvement of these systems.
Conclusion
This study has demonstrated a novel approach to addressing the limitations of previous Vanadium Dioxide (VO2) neuronal devices by preparing oxygen vacancies-modulated VO2-x films and fabricating VO2-x neuronal devices for Spiking Neural Network (SNN) construction.
The key findings of this research are:
- The VO2-x neuronal devices can operate at lower voltages and higher speeds compared to conventional VO2 devices, making them more suitable for practical applications.
- The researchers used the VO2-x neuronal devices to build a Spiking Neural Network (SNN) system, which achieved excellent accuracy in image recognition tasks when trained on the MNIST dataset.
- The study offers a effective strategy for optimizing neuromorphic computing systems through defect engineering, specifically the introduction of oxygen vacancies in the VO2 material.
These results represent an important advancement in the field of neuromorphic computing, as they bring us closer to the development of efficient and practical artificial neuronal devices that can better emulate the brain's complex information processing capabilities.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
๐ง
0
Oxygen vacancies modulated VO2 for neurons and Spiking Neural Network construction
Liang Li, Ting Zhou, Tong Liu, Zhiwei Liu, Yaping Li, Shuo Wu, Shanguang Zhao, Jinglin Zhu, Meiling Liu, Zhihan Lin, Bowen Sun, Jianjun Li, Fangwen Sun, Chongwen Zou
Artificial neuronal devices are the basic building blocks for neuromorphic computing systems, which have been motivated by realistic brain emulation. Aiming for these applications, various device concepts have been proposed to mimic the neuronal dynamics and functions. While till now, the artificial neuron devices with high efficiency, high stability and low power consumption are still far from practical application. Due to the special insulator-metal phase transition, Vanadium Dioxide (VO2) has been considered as an idea candidate for neuronal device fabrication. However, its intrinsic insulating state requires the VO2 neuronal device to be driven under large bias voltage, resulting in high power consumption and low frequency. Thus in the current study, we have addressed this challenge by preparing oxygen vacancies modulated VO2 film(VO2-x) and fabricating the VO2-x neuronal devices for Spiking Neural Networks (SNNs) construction. Results indicate the neuron devices can be operated under lower voltage with improved processing speed. The proposed VO2-x based back-propagation SNNs (BP-SNNs) system, trained with the MNIST dataset, demonstrates excellent accuracy in image recognition. Our study not only demonstrates the VO2-x based neurons and SNN system for practical application, but also offers an effective way to optimize the future neuromorphic computing systems by defect engineering strategy.
Read more5/3/2024
๐ง
0
Highly Reproducible and CMOS-compatible VO2-based Oscillators for Brain-inspired Computing
Olivier Maher, Roy Bernini, Nele Harnack, Bernd Gotsmann, Marilyne Sousa, Valeria Bragaglia, Siegfried Karg
With remarkable electrical and optical switching properties induced at low power and near room temperature (68C), vanadium dioxide (VO2) has sparked rising interest in unconventional computing among the phase-change materials research community. The scalability and the potential to compute beyond the von Neumann model make VO2 especially appealing for implementation in oscillating neural networks for artificial intelligence (AI) applications, to solve constraint satisfaction problems, and for pattern recognition. Its integration into large networks of oscillators on a Silicon platform still poses challenges associated with the stabilization in the correct oxidation state and the ability to fabricate a structure with predictable electrical behavior showing very low variability. In this work, the role played by the different annealing parameters applied by three methods (slow thermal annealing, flash annealing, and rapid thermal annealing), following the vanadium oxide atomic layer deposition (ALD), on the formation of VO2 grains is studied and an optimal substrate stack configuration that minimizes variability between devices is proposed. Material and electrical characterizations are performed on the different films and a step-by-step recipe to build reproducible VO2-based oscillators is presented, which is argued to be made possible thanks to the introduction of a hafnium oxide (HfO2) layer between the silicon substrate and the vanadium oxide layer. Up to seven nearly identical VO2-based devices are contacted simultaneously to create a network of oscillators, paving the way for large-scale implementation of VO2 oscillating neural networks.
Read more5/14/2024
๐ง
0
Optimisation challenge for superconducting adiabatic neural network implementing XOR and OR boolean functions
D. S. Pashin, M. V. Bastrakova, D. A. Rybin, I. I. Soloviev, A. E. Schegolev, N. V. Klenov
In this article, we consider designs of simple analog artificial neural networks based on adiabatic Josephson cells with a sigmoid activation function. A new approach based on the gradient descent method is developed to adjust the circuit parameters, allowing efficient signal transmission between the network layers. The proposed solution is demonstrated on the example of the system implementing XOR and OR logical operations.
Read more5/7/2024
๐งช
0
Voltage-Controlled Magnetoelectric Devices for Neuromorphic Diffusion Process
Yang Cheng, Qingyuan Shu, Albert Lee, Haoran He, Ivy Zhu, Haris Suhail, Minzhang Chen, Renhe Chen, Zirui Wang, Hantao Zhang, Chih-Yao Wang, Shan-Yi Yang, Yu-Chen Hsin, Cheng-Yi Shih, Hsin-Han Lee, Ran Cheng, Sudhakar Pamarti, Xufeng Kou, Kang L. Wang
Stochastic diffusion processes are pervasive in nature, from the seemingly erratic Brownian motion to the complex interactions of synaptically-coupled spiking neurons. Recently, drawing inspiration from Langevin dynamics, neuromorphic diffusion models were proposed and have become one of the major breakthroughs in the field of generative artificial intelligence. Unlike discriminative models that have been well developed to tackle classification or regression tasks, diffusion models as well as other generative models such as ChatGPT aim at creating content based upon contexts learned. However, the more complex algorithms of these models result in high computational costs using today's technologies, creating a bottleneck in their efficiency, and impeding further development. Here, we develop a spintronic voltage-controlled magnetoelectric memory hardware for the neuromorphic diffusion process. The in-memory computing capability of our spintronic devices goes beyond current Von Neumann architecture, where memory and computing units are separated. Together with the non-volatility of magnetic memory, we can achieve high-speed and low-cost computing, which is desirable for the increasing scale of generative models in the current era. We experimentally demonstrate that the hardware-based true random diffusion process can be implemented for image generation and achieve comparable image quality to software-based training as measured by the Frechet inception distance (FID) score, achieving ~10^3 better energy-per-bit-per-area over traditional hardware.
Read more7/18/2024