TRANSCRIBER CONFIDENCE IN RELATION TO ACCURACY OF TRANSCRIPTION.

Abstract

Measures of two aspects of performance--message intelligibility and expressed confidence in the correctness of transcription--were obtained from 8 Army enlisted men (untrained in communications) transcribing word lists received at 3 signal-to-noise ratios. Confidence was expressed through the use of a five-point rating scale ranging from 'fully confident' to 'not at all confident', and a separate rating was assigned to each word in a list as it was transcribed. A significant relationship was obtained between transcriber confidence and accuracy of transcription. As expected, both mean intelligibility and mean confidence ratings increased as a direct function of signal-to-noise ratio. Signal-to-noise ratio did not similarly affect the relationship between confidence and accuracy. Because of generally unpredictable and unstable listening conditions in the field, the relationship between confidence and accuracy--averaged across signal-to-noise ratios--appears to provide a stable measure which is the best practical basis for estimating transcript accuracy. Conclusion was that a positive relationship exists between transcriber confidence of correct reception and message intelligibility, even when personnel untrained in communications serve as transcribers. While far from perfect, the relationship is sufficient to warrant further research using trained communications transcribers. (Author)

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 1966
Accession Number
AD0642544

Entities

People

  • Eugene P. Stichman

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Accuracy
  • Word Lists

Readers

  • Psychometric Testing or Psychological Assessment.
  • Speech Processing/Speech Recognition.
  • Systems Analysis and Design