Univariate Lp and lp Averaging, 0 < p < 1, in Polynomial Time by Utilization of Statistical Structure

Abstract

We present evidence that one can calculate generically combinatorially expensive Lp and lp averages, 0 < p < 1, in polynomial time by restricting the data to come from a wide class of statistical distributions. Our approach differs from the approaches in the previous literature, which are based on a priori sparsity requirements or on accepting a local minimum as a replacement for a global minimum. The functionals by which Lp averages are calculated are not convex but are radially monotonic and the functionals by which lp averages are calculated are nearly so, which are the keys to solvability in polynomial time. Analytical results for symmetric, radially monotonic univariate distributions are presented. An algorithm for univariate lp averaging is presented. Computational results for a Gaussian distribution, a class of symmetric heavy-tailed distributions and a class of asymmetric heavy-tailed distributions are presented. Many phenomena in human-based areas are increasingly known to be represented by data that have large numbers of outliers and belong to very heavy-tailed distributions. When tails of distributions are so heavy that even medians (L1 and l1 averages) do not exist, one needs to consider using lp minimization principles with 0 < p < 1.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2012
Accession Number
ADA568729

Entities

People

  • John E. Lavery

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Algorithms
  • Cognitive Science
  • Compressed Sensing
  • Computer Science
  • Data Science
  • Data Sets
  • Electronic Mail
  • Gaussian Distributions
  • Image Processing
  • Information Science
  • Integrals
  • Military Research
  • Polynomials
  • Probability
  • Probability Density Functions
  • Statistical Distributions
  • Systems Engineering

Readers

  • Approximation Theory.
  • Mathematical Modeling and Probability Theory.
  • Seismology