AD-NEv++ : The multi-architecture neuroevolution-based multivariate anomaly detection framework
2404.07968
0
0
❗
Abstract
Anomaly detection tools and methods enable key analytical capabilities in modern cyberphysical and sensor-based systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model optimization for a given dataset is a cumbersome and time-consuming process. Neuroevolution could be an effective and efficient solution to this problem, as a fully automated search method for learning optimal neural networks, supporting both gradient and non-gradient fine tuning. However, existing frameworks incorporating neuroevolution lack of support for new layers and architectures and are typically limited to convolutional and LSTM layers. In this paper we propose AD-NEv++, a three-stage neuroevolution-based method that synergically combines subspace evolution, model evolution, and fine-tuning. Our method overcomes the limitations of existing approaches by optimizing the mutation operator in the neuroevolution process, while supporting a wide spectrum of neural layers, including attention, dense, and graph convolutional layers. Our extensive experimental evaluation was conducted with widely adopted multivariate anomaly detection benchmark datasets, and showed that the models generated by AD-NEv++ outperform well-known deep learning architectures and neuroevolution-based approaches for anomaly detection. Moreover, results show that AD-NEv++ can improve and outperform the state-of-the-art GNN (Graph Neural Networks) model architecture in all anomaly detection benchmarks.
Create account to get full access
Overview
- This paper provides a template for citing AI research papers in a standardized format.
- The template includes key citation elements such as author names, title, page numbers, and DOI.
- The paper was automatically generated using LaTeXML, a tool for converting LaTeX documents to HTML.
Plain English Explanation
This research paper offers a standardized template for citing AI research papers. The template includes all the key information needed to properly cite a paper, such as the author names, the title of the paper, the page numbers, and the digital object identifier (DOI). This makes it easier for researchers and others to consistently and accurately cite AI papers in their own work.
The paper itself was automatically generated using a tool called LaTeXML, which can convert documents written in the LaTeX typesetting language into HTML format. This allows the citation template to be presented in a web-friendly format.
Technical Explanation
The paper provides a template for citing AI research papers in a standardized "PRIME AI Style" format. The template includes the following citation elements:
- Authors
- Title
- Pages
- DOI: 000000/11111
The document was generated using LaTeXML (version 0.8.7), a tool for converting LaTeX source documents into HTML. This allows the citation template to be presented as a web page, with associated stylesheets and JavaScript for formatting and interactive features.
The HTML page includes a table of contents with links to the main sections, as well as references to external CSS and JavaScript libraries like Bootstrap for styling and functionality.
Critical Analysis
The paper offers a helpful standardized citation format for AI research, which can improve consistency and clarity when referencing these types of works. However, the template is fairly basic and does not include more advanced citation features like author affiliations, publication dates, or links to the full paper.
Additionally, while the automatic conversion from LaTeX to HTML is convenient, it may introduce some formatting artifacts or issues that could make the citations less readable or user-friendly. Further refinement of the template and conversion process could help address these potential limitations.
Overall, this paper provides a good starting point for standardizing AI paper citations, but there may be opportunities to expand and enhance the template based on the needs of researchers and readers.
Conclusion
This research paper offers a template for consistently citing AI research papers in a standardized "PRIME AI Style" format. The template includes key citation elements like author names, paper title, page numbers, and the DOI. By providing this template, the paper aims to improve the accuracy and clarity of citations for AI-related work.
The template is presented in an HTML format generated automatically from LaTeX source, which allows it to be easily shared and accessed online. While the template is relatively basic, it could serve as a foundation for further refinement and development of standardized citation practices in the AI research community.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🛠️
An algorithmic framework for the optimization of deep neural networks architectures and hyperparameters
Julie Keisler (EDF R&D OSIRIS, EDF R&D, CRIStAL, CRIStAL), El-Ghazali Talbi (CRIStAL, CRIStAL), Sandra Claudel (EDF R&D OSIRIS, EDF R&D), Gilles Cabriel (EDF R&D OSIRIS, EDF R&D)
0
0
In this paper, we propose an algorithmic framework to automatically generate efficient deep neural networks and optimize their associated hyperparameters. The framework is based on evolving directed acyclic graphs (DAGs), defining a more flexible search space than the existing ones in the literature. It allows mixtures of different classical operations: convolutions, recurrences and dense layers, but also more newfangled operations such as self-attention. Based on this search space we propose neighbourhood and evolution search operators to optimize both the architecture and hyper-parameters of our networks. These search operators can be used with any metaheuristic capable of handling mixed search spaces. We tested our algorithmic framework with an evolutionary algorithm on a time series prediction benchmark. The results demonstrate that our framework was able to find models outperforming the established baseline on numerous datasets.
5/15/2024
Neuroevolving Electronic Dynamical Networks
Derek Whitley
0
0
Neuroevolution is a powerful method of applying an evolutionary algorithm to refine the performance of artificial neural networks through natural selection; however, the fitness evaluation of these networks can be time-consuming and computationally expensive, particularly for continuous time recurrent neural networks (CTRNNs) that necessitate the simulation of differential equations. To overcome this challenge, field programmable gate arrays (FPGAs) have emerged as an increasingly popular solution, due to their high performance and low power consumption. Further, their ability to undergo dynamic and partial reconfiguration enables the extremely rapid evaluation of the fitness of CTRNNs, effectively addressing the bottleneck associated with conventional methods. By incorporating fitness evaluation directly upon the programmable logic of the FPGA, hyper-parallel evaluation becomes feasible, dramatically reducing the time required for assessment. This inherent parallelism of FPGAs accelerates the entire neuroevolutionary process by several orders of magnitude, facilitating faster convergence to an optimal solution. The work presented in this study demonstrates the potential of utilizing dynamic and partial reconfiguration on capable FPGAs as a powerful platform for neuroevolving dynamic neural networks.
4/9/2024
Towards evolution of Deep Neural Networks through contrastive Self-Supervised learning
Adriano Vinhas, Jo~ao Correia, Penousal Machado
0
0
Deep Neural Networks (DNNs) have been successfully applied to a wide range of problems. However, two main limitations are commonly pointed out. The first one is that they require long time to design. The other is that they heavily rely on labelled data, which can sometimes be costly and hard to obtain. In order to address the first problem, neuroevolution has been proved to be a plausible option to automate the design of DNNs. As for the second problem, self-supervised learning has been used to leverage unlabelled data to learn representations. Our goal is to study how neuroevolution can help self-supervised learning to bridge the gap to supervised learning in terms of performance. In this work, we propose a framework that is able to evolve deep neural networks using self-supervised learning. Our results on the CIFAR-10 dataset show that it is possible to evolve adequate neural networks while reducing the reliance on labelled data. Moreover, an analysis to the structure of the evolved networks suggests that the amount of labelled data fed to them has less effect on the structure of networks that learned via self-supervised learning, when compared to individuals that relied on supervised learning.
6/21/2024
🧠
Evolutionary Spiking Neural Networks: A Survey
Shuaijie Shen, Rui Zhang, Chao Wang, Renzhuo Huang, Aiersi Tuerhong, Qinghai Guo, Zhichao Lu, Jianguo Zhang, Luziwei Leng
0
0
Spiking neural networks (SNNs) are gaining increasing attention as potential computationally efficient alternatives to traditional artificial neural networks(ANNs). However, the unique information propagation mechanisms and the complexity of SNN neuron models pose challenges for adopting traditional methods developed for ANNs to SNNs. These challenges include both weight learning and architecture design. While surrogate gradient learning has shown some success in addressing the former challenge, the latter remains relatively unexplored. Recently, a novel paradigm utilizing evolutionary computation methods has emerged to tackle these challenges. This approach has resulted in the development of a variety of energy-efficient and high-performance SNNs across a wide range of machine learning benchmarks. In this paper, we present a survey of these works and initiate discussions on potential challenges ahead.
6/19/2024