A Multi-operator Ensemble LSHADE with Restart and Local Search Mechanisms for Single-objective Optimization
0
🛠️
Sign in to get full access
Overview
- This research paper proposes a new evolutionary algorithm called Multi-operator Ensemble LSHADE (ME-LSHADE) for single-objective optimization problems.
- The algorithm combines multiple search operators, a restart mechanism, and a local search component to improve the performance of the LSHADE algorithm.
- Experiments are conducted on a set of benchmark functions to evaluate the effectiveness of the proposed approach.
Plain English Explanation
The paper describes a new evolutionary algorithm called Multi-operator Ensemble LSHADE (ME-LSHADE) that is designed to solve single-objective optimization problems. Optimization problems are common in fields like engineering, finance, and logistics, where the goal is to find the best solution from a set of possible options.
The key idea behind ME-LSHADE is to combine multiple search operators - different ways of generating new candidate solutions - within a single algorithm. This allows the algorithm to explore the search space more effectively and find better solutions.
Additionally, the algorithm incorporates a restart mechanism that can help the algorithm escape from local optima, and a local search component that can refine the final solutions.
The performance of ME-LSHADE is evaluated on a set of benchmark optimization problems, and the results show that it can outperform other state-of-the-art evolutionary algorithms in terms of solution quality and convergence speed.
Technical Explanation
The proposed ME-LSHADE algorithm is based on the LSHADE algorithm, which is a successful variant of the Differential Evolution (DE) optimization algorithm. LSHADE incorporates adaptive parameter control and a success-history-based parameter adaptation mechanism to improve its performance.
The key contributions of the ME-LSHADE algorithm are:
-
Multi-operator Ensemble: The algorithm employs a set of different mutation and crossover operators, which are selected and applied adaptively during the optimization process. This allows the algorithm to explore the search space more effectively.
-
Restart Mechanism: The algorithm periodically restarts the optimization process with a new population, which can help the algorithm escape from local optima and explore new regions of the search space.
-
Local Search: The algorithm incorporates a local search component that is applied to the best solutions found during the optimization process. This can help refine the final solutions and improve their quality.
The performance of ME-LSHADE is evaluated on a set of 30 benchmark functions from the CEC 2017 single-objective optimization competition. The results show that ME-LSHADE outperforms other state-of-the-art evolutionary algorithms, including the original LSHADE algorithm, in terms of solution quality and convergence speed.
Critical Analysis
The paper provides a thorough experimental evaluation of the proposed ME-LSHADE algorithm, which is a strength of the research. However, the authors do not discuss any potential limitations or caveats of the approach.
For example, the paper does not explore the impact of the number of search operators or the specific parameter settings of the restart and local search mechanisms on the algorithm's performance. Additionally, the authors do not compare the computational complexity of ME-LSHADE to other algorithms, which could be an important consideration for real-world applications.
Furthermore, the paper does not discuss the potential challenges of applying the ME-LSHADE algorithm to larger-scale or more complex optimization problems, or how the algorithm might perform in the presence of noisy or dynamic objective functions.
Conclusion
The ME-LSHADE algorithm proposed in this paper represents an interesting and promising approach to single-objective optimization problems. By combining multiple search operators, a restart mechanism, and a local search component, the algorithm can effectively explore the search space and find high-quality solutions.
The experimental results demonstrate the algorithm's ability to outperform other state-of-the-art evolutionary algorithms on a set of benchmark functions. However, further research is needed to explore the algorithm's limitations, scalability, and potential applications in real-world optimization problems.
Overall, this paper contributes to the ongoing research in the field of evolutionary algorithms and provides a valuable addition to the toolbox of optimization techniques.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🛠️
0
A Multi-operator Ensemble LSHADE with Restart and Local Search Mechanisms for Single-objective Optimization
Dikshit Chauhan, Anupam Trivedi, Shivani
In recent years, multi-operator and multi-method algorithms have succeeded, encouraging their combination within single frameworks. Despite promising results, there remains room for improvement as only some evolutionary algorithms (EAs) consistently excel across all optimization problems. This paper proposes mLSHADE-RL, an enhanced version of LSHADE-cnEpSin, which is one of the winners of the CEC 2017 competition in real-parameter single-objective optimization. mLSHADE-RL integrates multiple EAs and search operators to improve performance further. Three mutation strategies such as DE/current-to-pbest-weight/1 with archive, DE/current-to-pbest/1 without archive, and DE/current-to-ordpbest-weight/1 are integrated in the original LSHADE-cnEpSin. A restart mechanism is also proposed to overcome the local optima tendency. Additionally, a local search method is applied in the later phase of the evolutionary procedure to enhance the exploitation capability of mLSHADE-RL. mLSHADE-RL is tested on 30 dimensions in the CEC 2024 competition on single objective bound constrained optimization, demonstrating superior performance over other state-of-the-art algorithms in producing high-quality solutions across various optimization scenarios.
Read more9/25/2024
🔄
0
An Efficient Reconstructed Differential Evolution Variant by Some of the Current State-of-the-art Strategies for Solving Single Objective Bound Constrained Problems
Sichen Tao, Ruihan Zhao, Kaiyu Wang, Shangce Gao
Complex single-objective bounded problems are often difficult to solve. In evolutionary computation methods, since the proposal of differential evolution algorithm in 1997, it has been widely studied and developed due to its simplicity and efficiency. These developments include various adaptive strategies, operator improvements, and the introduction of other search methods. After 2014, research based on LSHADE has also been widely studied by researchers. However, although recently proposed improvement strategies have shown superiority over their previous generation's first performance, adding all new strategies may not necessarily bring the strongest performance. Therefore, we recombine some effective advances based on advanced differential evolution variants in recent years and finally determine an effective combination scheme to further promote the performance of differential evolution. In this paper, we propose a strategy recombination and reconstruction differential evolution algorithm called reconstructed differential evolution (RDE) to solve single-objective bounded optimization problems. Based on the benchmark suite of the 2024 IEEE Congress on Evolutionary Computation (CEC2024), we tested RDE and several other advanced differential evolution variants. The experimental results show that RDE has superior performance in solving complex optimization problems.
Read more4/26/2024
💬
0
Multi-objective Evolution of Heuristic Using Large Language Model
Shunyu Yao, Fei Liu, Xi Lin, Zhichao Lu, Zhenkun Wang, Qingfu Zhang
Heuristics are commonly used to tackle diverse search and optimization problems. Design heuristics usually require tedious manual crafting with domain knowledge. Recent works have incorporated large language models (LLMs) into automatic heuristic search leveraging their powerful language and coding capacity. However, existing research focuses on the optimal performance on the target problem as the sole objective, neglecting other criteria such as efficiency and scalability, which are vital in practice. To tackle this challenge, we propose to model heuristic search as a multi-objective optimization problem and consider introducing other practical criteria beyond optimal performance. Due to the complexity of the search space, conventional multi-objective optimization methods struggle to effectively handle multi-objective heuristic search. We propose the first LLM-based multi-objective heuristic search framework, Multi-objective Evolution of Heuristic (MEoH), which integrates LLMs in a zero-shot manner to generate a non-dominated set of heuristics to meet multiple design criteria. We design a new dominance-dissimilarity mechanism for effective population management and selection, which incorporates both code dissimilarity in the search space and dominance in the objective space. MEoH is demonstrated in two well-known combinatorial optimization problems: the online Bin Packing Problem (BPP) and the Traveling Salesman Problem (TSP). Results indicate that a variety of elite heuristics are automatically generated in a single run, offering more trade-off options than existing methods. It successfully achieves competitive or superior performance while improving efficiency up to 10 times. Moreover, we also observe that the multi-objective search introduces novel insights into heuristic design and leads to the discovery of diverse heuristics.
Read more9/26/2024
0
Archive-based Single-Objective Evolutionary Algorithms for Submodular Optimization
Frank Neumann, Gunter Rudolph
Constrained submodular optimization problems play a key role in the area of combinatorial optimization as they capture many NP-hard optimization problems. So far, Pareto optimization approaches using multi-objective formulations have been shown to be successful to tackle these problems while single-objective formulations lead to difficulties for algorithms such as the $(1+1)$-EA due to the presence of local optima. We introduce for the first time single-objective algorithms that are provably successful for different classes of constrained submodular maximization problems. Our algorithms are variants of the $(1+lambda)$-EA and $(1+1)$-EA and increase the feasible region of the search space incrementally in order to deal with the considered submodular problems.
Read more6/21/2024