Eucalyptus: Integrating Natural Language Input with a Graphical User Interface

Abstract

This report describes Eucalyptus, a natural language (NL) interface that has been integrated with the graphical user interface of the KOALAS Test Planning Tool, a simulated Naval air combat command system. The multimodal, multimedia interface handles both imperative commands and database queries (either typed or spoken into a microphone) while still allowing full use of the original graphical interface. In this way the precision and consistency of direct manipulation is balanced and augmented by the descriptive power and reduced redundancy of NL. The two input media used together yield such powerful interaction techniques as deixis (simultaneous speech and pointing) and the ability to use mouse clicks and verbal referring expressions interchangeably. Finally, the system's discourse handling capability allows abbreviated NL follow-ups (anaphora and ellipsis) to receive full interpretations based on the prior interaction context, whether verbal or graphical. Natural language processing, Human-computer interface, Speech recognition.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Feb 25, 1994
Accession Number
ADA276914

Entities

People

  • Kenneth Wauchope

Organizations

  • United States Naval Research Laboratory

Tags

Communities of Interest

  • Air Platforms
  • Autonomy
  • C4I
  • Ground and Sea Platforms
  • Weapons Technologies

DTIC Thesaurus Topics

  • Aircrafts
  • Application Software
  • Artificial Intelligence
  • Automated Speech Recognition
  • Command And Control
  • Computers
  • Databases
  • Graphical User Interface
  • Human-Computer Interaction
  • Human-Computer Interfaces
  • Information Systems
  • Language
  • Natural Language Processing
  • Natural Languages
  • Recognition
  • Tanker Aircraft
  • User Interface

Readers

  • Computational Linguistics
  • Speech Processing/Speech Recognition.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Machine Translation