INFORMATION RATES OF AUTOEGRESSIVE SOURCES.
Abstract
The rate distortion function, R(D), of a source can be interpreted as being the average amount of information that must be transmitted about a source for the receiver to be able to approximate the source within an average distortion D. It is demonstrated that for the class of time discrete autoregressive sources the rate distortion function for any difference distortion measure is lower bounded by the rate distortion function of the independent letter source that generates the autoregressive source. Autoregressive sources are constructed by passing such an independent letter source through a time discrete linear filter whose z-transform has only poles. This behavior holds even if the autoregressive source is non-stationary. The lower bound is shown to hold with equality for a non-zero range of small average distortion for two important special cases: the class of possibly nonstationary Gaussian autoregressive processes with a mean square error fidelity criterion and the binary symmetric first order Markov source with an average error per bit fidelity criterion. The positive coding theorem is proven for the possibly nonstationary Gaussian autoregressive process with a constraint on its parameters. (Author)
Document Details
- Document Type
- Technical Report
- Publication Date
- Aug 01, 1969
- Accession Number
- AD0695717
Entities
People
- Robert M. Gray
Organizations
- University of Southern California