Effect of Coefficient Rounding in Floating-Point Digital Filters,
Abstract
The paper analyzes the effect of coefficient rounding in digital filters using floating-point arithmetic. An error is defined as the difference between the output of a digital filter realized with a finite number of bits and the output of the same filter using infinite number of bits. It is shown that this error consists of two uncorrelated components. One component is due to the rounding of the arithmetic operations alone, and the other component represents the additional error due to coefficient rounding. Expressions are derived for the mean square value of the error for the three canonical programming forms. The stability problem is studied by examining the shift of the pole locations due to the coefficient rounding. Mean square value of the shift is calculated. Good agreement between the theoretical and experimental results are obtained. (Author)
Document Details
- Document Type
- Technical Report
- Publication Date
- Jul 01, 1971
- Accession Number
- AD0727073
Entities
People
- Bede Liu
- Toyohisa Kaneko
Organizations
- Princeton University