A genetic Gaussian process regression model based on memetic algorithm
来源期刊:中南大学学报(英文版)2013年第11期
论文作者:张乐 LIU Zhong(刘忠) ZHANG Jian-qiang(张建强) REN Xiong-wei(任雄伟)
文章页码:3085 - 3093
Key words:Gaussian process; hyper-parameters optimization; memetic algorithm; regression model
Abstract: Gaussian process (GP) has fewer parameters, simple model and output of probabilistic sense, when compared with the methods such as support vector machines. Selection of the hyper-parameters is critical to the performance of Gaussian process model. However, the common-used algorithm has the disadvantages of difficult determination of iteration steps, over-dependence of optimization effect on initial values, and easily falling into local optimum. To solve this problem, a method combining the Gaussian process with memetic algorithm was proposed. Based on this method, memetic algorithm was used to search the optimal hyper parameters of Gaussian process regression (GPR) model in the training process and form MA-GPR algorithms, and then the model was used to predict and test the results. When used in the marine long-range precision strike system (LPSS) battle effectiveness evaluation, the proposed MA-GPR model significantly improved the prediction accuracy, compared with the conjugate gradient method and the genetic algorithm optimization process.
ZHANG Le(张乐)1, 2, LIU Zhong(刘忠)1, ZHANG Jian-qiang(张建强)1, REN Xiong-wei(任雄伟)1
(1. College of Electronic, Naval University of Engineering, Wuhan 430033, China;
2. Wuhan Mechanical Technology College, Wuhan 430075, China)
Abstract:Gaussian process (GP) has fewer parameters, simple model and output of probabilistic sense, when compared with the methods such as support vector machines. Selection of the hyper-parameters is critical to the performance of Gaussian process model. However, the common-used algorithm has the disadvantages of difficult determination of iteration steps, over-dependence of optimization effect on initial values, and easily falling into local optimum. To solve this problem, a method combining the Gaussian process with memetic algorithm was proposed. Based on this method, memetic algorithm was used to search the optimal hyper parameters of Gaussian process regression (GPR) model in the training process and form MA-GPR algorithms, and then the model was used to predict and test the results. When used in the marine long-range precision strike system (LPSS) battle effectiveness evaluation, the proposed MA-GPR model significantly improved the prediction accuracy, compared with the conjugate gradient method and the genetic algorithm optimization process.
Key words:Gaussian process; hyper-parameters optimization; memetic algorithm; regression model