Some Topics in Statistical Information Theory
Abstract
Attention is focused on informational properties of sub-sigma-algebras of the fundamental probability space in contrast to the discussion in Information Theory and Statistics (Wiley 1959, Dover Publications Inc. 1968) where attention is devoted to informational properties of statistics, that is, random variables. Properties of relative conditional expectations and results on separable sigma-algebras are stated for later use. The discrimination information in a sigma-algebra (sub-sigma-algebra) is defined and various properties developed, in particular the relation between information and sufficiency. The integral representative theorem for discrimination information is derived by methods believed to be more inherently information-theoretic than others that have been presented. Monotonic properties of conditional discrimination information are derived with respect to either the conditioning sub-sigma-algebra or the conditioned sub-sigma-algebra.
Document Details
- Document Type
- Technical Report
- Publication Date
- Nov 15, 1973
- Accession Number
- AD0770130
Entities
People
- S. Kullback
Organizations
- George Washington University