Bayesian optimization of multi-layer perceptron models for power distribution system state estimation

Abstract

Feedforward multilayer perceptron models (MLPs) have been applied to power distribution system state estimation (DSSE) in the past. Existing methods usually employ an ad-hoc or trial and error approach to MLP hyperparameter selection, and thus a systematic way of selecting the optimal hyperparameters including the number of neurons per hidden layer, learning rate, number of training epochs and training batch size is desirable and needed. This paper presents an approach based on Bayesian Optimization with Gaussian Processes for selecting MLP model hyperparameters for state estimation purposes. Results of the optimized MLP models are presented alongside the unoptimized models to compare performance of training, testing, and validation in terms of root-mean-squared-error (RMSE). Additionally, machine learning pipelines were employed and total execution time (seconds) for each trial is presented. The study shows that the MLP models obtained through the proposed optimization method outperform unoptimized models in terms of generalization capability for unseen, new cases.

Document Details

Document Type
Pub Defense Publication
Publication Date
Jun 12, 2023
Source ID
10.1515/ijeeps-2022-0328

Entities

People

  • James Carmichael
  • Yuan Liao

Organizations

  • United States Department of Defense
  • University of Kentucky

Tags

Fields of Study

  • Computer science

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Computational Modeling and Simulation
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks