Questionnaire Measuring the Utility of Knowledge-Based Systems.

Abstract

This paper describes the development and validation of an off-the-shelf questionnaire designed to be tailored, as needed, to obtain the opinions of potential users of knowledge based systems. Development began with a literature review to identify criteria used by different researchers to assess system utility and usability. The identified criteria then were organized into a multi-attributed hierarchy with the top three dimensions being Effect on Task Performance, System Usability, and System Fit. The bottom-level attributes were used to develop the questions for assessing system utility. In May 1994, the questionnaire was successfully tailored and used by the Army's Battle Command Battle Laboratory to evaluate 11 decision aiding prototypes. The questionnaire distinguished between those prototypes the soldiers liked and those that they did not. Psychometric analyses indicated the questionnaire passed required tests for reliability and validity.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1996
Accession Number
ADA309015

Entities

People

  • Ann P. Trent
  • James Gualtieri
  • Leonard Adelman
  • Sharon L. Riedel

Organizations

  • Battelle Memorial Institute

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Army Personnel
  • Artificial Intelligence
  • Cognitive Systems Engineering
  • Decision Support Systems
  • Expert Systems
  • Human Factors Engineering
  • Human-Computer Interaction
  • Human-Computer Interfaces
  • Information Systems
  • Knowledge Based Systems
  • Literature Surveys
  • Personnel Management
  • Prototypes
  • Psychology
  • Reliability
  • Social Sciences
  • Task Performance And Analysis

Readers

  • Instructional Design and Training Evaluation.
  • Software Engineering.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.