Evaluation Methods for Complex Intelligent Information Systems (EMCIIS)

Abstract

The objective of the EMCIIS effort was to perform research and development studies and experiments to demonstrate improvements in methods for evaluating the behavior and performance of Complex Intelligent Information Systems (CIIS). The critical goals achieved during the life of this effort included the following: (1) Make evaluation methods and tools accessible to CIIS researchers and developers through an Evaluation of Information Systems (EIS) on-line web site. The hypertext accessible methods were developed using Hypertext Markup Language (HTML) and were made available through the World Wide Web (WWW). (2) Develop a Hypertext CIIS Evaluation Field Guide. The hypertext Field Guide provided tools for the evaluation of information systems and was made available through the WWW. In addition, the effectiveness of the Field Guide as an aid to CIIS researchers, developers, and evaluators was assessed. (3) Advance the state of evaluation methods and research in support of CIIS incorporation into C4I and other systems. The primary product is the EIS WWW site which provides a centralized location for AI researchers seeking information on and assistance with, AIL systems evaluation. Development of the site and its on-line tools was carried out by Sterling Software, the University of Massachusetts (UMASS), and Colorado State University (CSU).

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 1998
Accession Number
ADA349294

Entities

People

  • Adele E. Howe
  • Kasey Dingman
  • Paul Losiewicz

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Air Force Research Laboratories
  • Artificial Intelligence
  • Computer Programs
  • Computer Science
  • Computers
  • Data Analysis
  • Databases
  • Html
  • Information Science
  • Information Systems
  • Language
  • Markup Languages
  • Network Science
  • Operating Systems
  • Web Browsers
  • Websites
  • World Wide Web

Fields of Study

  • Computer science

Readers

  • Computational Linguistics
  • Fluid Dynamics.
  • Instructional Design and Training Evaluation.