Human Benchmarking of Expert Systems. Literature Review

Abstract

This literature review provides a context for using the human benchmarking approach with expert systems. It includes three parts: the current status of expert system evaluation, a search for cognitive instruments, and a parallel comparison of categories between expert systems and cognitive skill instruments. The review suggests that there are different approaches to expert system evaluation including evaluation criteria and evaluation procedures. The literature offers diverse environments for capturing developmental aspects of expert system evaluation. The review suggests the possibility of developing a psychometric standard for the evaluation of expert systems and documents similarities and differences between cognitive psychology and artificial intelligence, which is important for the human benchmarking approach.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1990
Accession Number
ADA233602

Entities

People

  • Anat Jacoby
  • Harold F. O'neil Jr.
  • Yujing Ni

Organizations

  • University of California, Los Angeles

Tags

Communities of Interest

  • Biomedical
  • Engineered Resilient Systems
  • Human Systems

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Cognition
  • Cognitive Science
  • Computer Programming
  • Computer Science
  • Computers
  • Department Of Defense
  • Engineering
  • Expert Systems
  • Literature Surveys
  • Measurement
  • Psychology
  • Reasoning
  • Software Development
  • Systems Engineering
  • Test And Evaluation
  • United States Government

Readers

  • Instructional Design and Training Evaluation.

Technology Areas

  • AI & ML