A Flexible Evolutionary Algorithm With Dynamic Mutation Rate Archive

Read original: arXiv:2404.04015 - Published 4/8/2024 by Martin S. Krejca, Carsten Witt
Total Score

0

🔍

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Proposes a flexible evolutionary algorithm with a dynamic mutation rate archive
  • Aims to improve the performance and efficiency of evolutionary algorithms
  • Focuses on adapting the mutation rate during the evolutionary process

Plain English Explanation

This research paper presents a new approach to evolutionary algorithms, which are a type of optimization technique inspired by the process of natural selection. Evolutionary algorithms work by creating and modifying a population of candidate solutions, and then selecting the best ones to "survive" and produce the next generation of solutions.

The key innovation in this paper is the introduction of a dynamic mutation rate archive. Mutation is the process of randomly changing parts of a candidate solution, and the mutation rate - the frequency at which mutations occur - can have a big impact on the algorithm's performance. The authors propose keeping track of the mutation rates that have been successful in the past, and using that information to dynamically adjust the mutation rate during the evolutionary process.

The idea is that this dynamic adjustment of the mutation rate can help the algorithm find better solutions more efficiently, by allowing it to explore the search space more effectively. The paper provides a theoretical analysis of the algorithm's runtime and properties, as well as empirical results showing improvements over standard evolutionary algorithms.

Technical Explanation

The paper introduces a new evolutionary algorithm called the "Flexible Evolutionary Algorithm with Dynamic Mutation Rate Archive" (FEADMR). The key components of this algorithm are:

  1. Dynamic Mutation Rate: Instead of using a fixed mutation rate throughout the evolutionary process, FEADMR adapts the mutation rate based on the success of previous mutations. It maintains an archive of mutation rates and their associated fitness values, and uses this information to adjust the mutation rate during the algorithm's execution.

  2. Mutation Rate Adaptation: The algorithm periodically evaluates the performance of different mutation rates in the archive and selects the one that has performed best so far. This selected mutation rate is then used to generate new candidate solutions.

  3. Theoretical Analysis: The paper provides a runtime analysis of FEADMR, showing that it can outperform standard evolutionary algorithms in terms of the number of function evaluations required to find a near-optimal solution.

  4. Empirical Evaluation: The authors test FEADMR on a range of benchmark optimization problems and compare its performance to that of other evolutionary algorithms. The results demonstrate that FEADMR can achieve superior performance, particularly on problems with difficult-to-tune parameters.

Critical Analysis

The paper presents a well-designed and theoretically grounded approach to improving the performance of evolutionary algorithms. The dynamic mutation rate archive is a clever idea that allows the algorithm to adapt its behavior based on past successes, which can be particularly useful for problems with complex or difficult-to-tune parameters.

However, the paper does not address some potential limitations of the approach. For example, the runtime analysis assumes that the algorithm can accurately estimate the fitness of candidate solutions, which may not always be the case in real-world optimization problems. Additionally, the empirical evaluation is limited to a relatively small set of benchmark problems, and it would be valuable to see how FEADMR performs on a wider range of optimization challenges.

Overall, the research presented in this paper is a valuable contribution to the field of evolutionary optimization, and the dynamic mutation rate archive is an interesting concept that warrants further investigation and testing.

Conclusion

This paper introduces a new evolutionary algorithm that adaptively adjusts its mutation rate during the optimization process, drawing on a dynamic archive of past successful mutation rates. The theoretical and empirical results demonstrate that this approach can lead to improved performance compared to standard evolutionary algorithms, particularly on problems with complex parameter landscapes.

While the paper does not address all potential limitations of the method, it presents a compelling and well-designed approach to enhancing the flexibility and efficiency of evolutionary optimization techniques. The dynamic mutation rate archive is a promising concept that could have broader applications in the field of stochastic optimization.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔍

Total Score

0

A Flexible Evolutionary Algorithm With Dynamic Mutation Rate Archive

Martin S. Krejca, Carsten Witt

We propose a new, flexible approach for dynamically maintaining successful mutation rates in evolutionary algorithms using $k$-bit flip mutations. The algorithm adds successful mutation rates to an archive of promising rates that are favored in subsequent steps. Rates expire when their number of unsuccessful trials has exceeded a threshold, while rates currently not present in the archive can enter it in two ways: (i) via user-defined minimum selection probabilities for rates combined with a successful step or (ii) via a stagnation detection mechanism increasing the value for a promising rate after the current bit-flip neighborhood has been explored with high probability. For the minimum selection probabilities, we suggest different options, including heavy-tailed distributions. We conduct rigorous runtime analysis of the flexible evolutionary algorithm on the OneMax and Jump functions, on general unimodal functions, on minimum spanning trees, and on a class of hurdle-like functions with varying hurdle width that benefit particularly from the archive of promising mutation rates. In all cases, the runtime bounds are close to or even outperform the best known results for both stagnation detection and heavy-tailed mutations.

Read more

4/8/2024

Effective Adaptive Mutation Rates for Program Synthesis
Total Score

0

Effective Adaptive Mutation Rates for Program Synthesis

Andrew Ni, Lee Spector

The problem-solving performance of many evolutionary algorithms, including genetic programming systems used for program synthesis, depends on the values of hyperparameters including mutation rates. The mutation method used to produce some of the best results to date on software synthesis benchmark problems, Uniform Mutation by Addition and Deletion (UMAD), adds new genes into a genome at a predetermined rate and then deletes genes at a rate that balances the addition rate, producing no size change on average. While UMAD with a predetermined addition rate outperforms many other mutation and crossover schemes, we do not expect a single rate to be optimal across all problems or all generations within one run of an evolutionary system. However, many current adaptive mutation schemes such as self-adaptive mutation rates suffer from pathologies like the vanishing mutation rate problem, in which the mutation rate quickly decays to zero. We propose an adaptive bandit-based scheme that addresses this problem and essentially removes the need to specify a mutation rate. Although the proposed scheme itself introduces hyperparameters, we either set these to good values or ensemble them in a reasonable range. Results on software synthesis and symbolic regression problems validate the effectiveness of our approach.

Read more

6/26/2024

An Archive Can Bring Provable Speed-ups in Multi-Objective Evolutionary Algorithms
Total Score

0

An Archive Can Bring Provable Speed-ups in Multi-Objective Evolutionary Algorithms

Chao Bian, Shengjie Ren, Miqing Li, Chao Qian

In the area of multi-objective evolutionary algorithms (MOEAs), there is a trend of using an archive to store non-dominated solutions generated during the search. This is because 1) MOEAs may easily end up with the final population containing inferior solutions that are dominated by other solutions discarded during the search process and 2) the population that has a commensurable size of the problem's Pareto front is often not practical. In this paper, we theoretically show, for the first time, that using an archive can guarantee speed-ups for MOEAs. Specifically, we prove that for two well-established MOEAs (NSGA-II and SMS-EMOA) on two commonly studied problems (OneMinMax and LeadingOnesTrailingZeroes), using an archive brings a polynomial acceleration on the expected running time. The reason is that with an archive, the size of the population can reduce to a small constant; there is no need for the population to keep all the Pareto optimal solutions found. This contrasts existing theoretical studies for MOEAs where a population with a commensurable size of the problem's Pareto front is needed. The findings in this paper not only provide a theoretical confirmation for an increasingly popular practice in the design of MOEAs, but can also be beneficial to the theory community towards studying more practical MOEAs.

Read more

6/5/2024

Multi-Objective Evolutionary Algorithms with Sliding Window Selection for the Dynamic Chance-Constrained Knapsack Problem
Total Score

0

Multi-Objective Evolutionary Algorithms with Sliding Window Selection for the Dynamic Chance-Constrained Knapsack Problem

Kokila Kasuni Perera, Aneta Neumann

Evolutionary algorithms are particularly effective for optimisation problems with dynamic and stochastic components. We propose multi-objective evolutionary approaches for the knapsack problem with stochastic profits under static and dynamic weight constraints. The chance-constrained problem model allows us to effectively capture the stochastic profits and associate a confidence level to the solutions' profits. We consider a bi-objective formulation that maximises expected profit and minimises variance, which allows optimising the problem independent of a specific confidence level on the profit. We derive a three-objective formulation by relaxing the weight constraint into an additional objective. We consider the GSEMO algorithm with standard and a sliding window-based parent selection to evaluate the objective formulations. Moreover, we modify fitness formulations and algorithms for the dynamic problem variant to store some infeasible solutions to cater to future changes. We conduct experimental investigations on both problems using the proposed problem formulations and algorithms. Our results show that three-objective approaches outperform approaches that use bi-objective formulations, and they further improve when GSEMO uses sliding window selection.

Read more

4/15/2024