Coordinating Text and Graphics in Explanation Generation

Abstract

To generate multimedia explanations, a system must he able to coordinate the use of different media in a single explanation. In this paper, we present an architecture that we have developed for COMET (COordinated Multimedia Explanation Testbed), a system that generates directions for equipment maintenance and repair, and we show how it addresses the coordination problem. In particular, we focus on the use of a single content planner that produces a common content description used by multiple media-specific generators, a media coordinator that makes a fine-grained division of information between media, and bidirectional interaction between media-specific generators to allow influence across media.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1989
Accession Number
ADA460217

Entities

People

  • Kathleen R. Mckeown
  • Steven K. Feiner

Organizations

  • Columbia University

Tags

Communities of Interest

  • Human Systems
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Abstracts
  • Artificial Intelligence
  • Computer Science
  • Demographic Cohorts
  • Directives
  • Frequency
  • Generators
  • Grammars
  • Graphics
  • Hierarchies
  • Language
  • Maintenance
  • Media
  • Multimedia
  • Natural Languages
  • New York
  • Production

Fields of Study

  • Computer science

Readers

  • Computer Science/Computer Engineering/Data Science/Digital Signal Processing.
  • Geospatial Intelligence and Artificial Intelligence Analytics
  • Joint Military Operations and Doctrine.