Cancellation and Rounding Errors.

Abstract

The fact that a calculating machine can usually hold only an approximation to the number that one is concerned with leads to cancellation errors and rounding errors. These concepts are defined precisely and examples are given. Suggestions are given for reducing (when possible) the size of errors arising from these two effects.

Document Details

Document Type
Technical Report
Publication Date
Apr 01, 1976
Accession Number
ADA028231

Entities

People

  • J. Barkley Rosser
  • J. Michael Yohe

Organizations

  • University of Wisconsin–Madison

Tags

DTIC Thesaurus Topics

  • Cancellation

Fields of Study

  • Mathematics

Readers

  • Approximation Theory.
  • Theoretical Analysis.