Maximum-Likelihood Estimation and Scoring Under Parametric Constraints

Abstract

Maximum likelihood (ML) estimation is a popular approach in solving many signal processing problems. Many of these problems cannot be solved analytically and so numerical techniques such as the method of scoring are applied. However, in many scenarios, it is desirable to modify the ML problem with the inclusion of additional side information. Often this side information is in the form of parametric constraints which the ML estimate (MLE) must now satisfy. We examine the asymptotic normality of the constrained ML (CML) problem and show that it is still consistent as well as asymptotically efficient (with respect to the constrained Cramer-Rao bound). We also generalize the method of scoring to include the constraints, and satisfy the constraints after each iterate. Convergence properties and examples verify the usefulness of the constrained scoring approach. As a particular example, an alternative and more general CML estimator is developed for the linear model with linear constraints.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 01, 2006
Accession Number
ADA448612

Entities

People

  • Brian M. Sadler
  • Terrence J. Moore

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Advanced Electronics
  • Energy and Power Technologies
  • Materials and Manufacturing Processes
  • Sensors

DTIC Thesaurus Topics

  • Algorithms
  • Asymptotic Normality
  • Computational Science
  • Convergence
  • Convex Sets
  • Data Science
  • Estimators
  • Information Processing
  • Information Science
  • Maximum Likelihood Estimation
  • Military Research
  • Nonlinear Dynamics
  • Normality
  • Signal Processing
  • Simulations
  • Statistical Algorithms
  • Statistical Inference

Fields of Study

  • Engineering
  • Mathematics

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Regression Analysis.