An Approach to Visual Interaction in Mixed-Initiative Planning

Abstract

Researchers in mixed-initiative problem-solving have generally viewed interaction between the user and the system as a form of dialog, which provides an effective unifying framework for multimodal systems. For mixed-initiative interaction through a visual medium, however, an approach that exploits our visual perceptual abilities and the benefits of direct manipulation mechanisms is equally compelling. This paper explores the possibility of communication between human planners and intelligent planning systems via shared control of a three-dimensional graphical user interface. We are currently testing our early development efforts in the Visual Interaction Dialog (VID) system, which supports agent and user manipulation of camera placement for communicating plan structure and domain information.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1999
Accession Number
ADA462145

Entities

People

  • David A. Pegram
  • Mark Riedl
  • Robert St. Amant

Organizations

  • North Carolina State University

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Cameras
  • Cognitive Systems Engineering
  • Complex Systems
  • Computer Graphics
  • Computer Science
  • Computers
  • Data Analysis
  • Graphics
  • Human-Computer Interaction
  • Psychology
  • Simulators
  • Software Agents
  • Three Dimensional
  • User Interface
  • Visual Perception
  • Visualizations

Readers

  • Artificial Intelligence
  • Human-Computer Interaction (HCI).
  • Systems Analysis and Design