Prediction and Entropy.

Abstract

The emergence of the magic number 2 in recent statistical literature is explained by adopting the predictive point of view of statistics with entropy as the basic criterion of the goodness of a fitted model. The historical development of the concept of entropy is reviewed and its relation to statistics is explained by examples. The importance of the entropy maximization principle as the basis of the unification of conventional and Bayesian statistics is discussed. (Author)

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 1982
Accession Number
ADA120956

Entities

People

  • Hirotugu Akaike

Organizations

  • University of Wisconsin–Madison

Tags

Communities of Interest

  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Bayesian Inference
  • Bayesian Networks
  • Data Mining
  • Data Science
  • Factor Analysis
  • Information Science
  • Information Theory
  • Mathematics
  • Observation
  • Probability
  • Probability Distributions
  • Random Variables
  • Statistical Algorithms
  • Statistical Distributions
  • Statistical Inference
  • Statistics
  • United States

Readers

  • Calculus or Mathematical Analysis
  • Military History / Militaries and War Studies
  • Regression Analysis.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Translation