Multi-Sensory, Multi-Modal Concepts for Information Understanding
Abstract
In recent years, extensive research has focused on the development of techniques for multi-sensor data fusion systems. These fusion systems process data from multiple sensors to develop improved estimates of the position, velocity, attributes, and identity of entities such as targets or entities of interest. Typically, the fused data are displayed on a geographical information display (e.g., data are overlaid on a map with terrain features, political information, and the data are shown as icons representing the observed entities). Analysts interpret the data to develop an assessment of an evolving situation or threat. Despite significant improvements in computer displays, haptic interface devices, and new three-dimensional full-immersion display capabilities, the data fusion displays have seen little changes to take advantage of a human s ability to access data. This paper describes two concepts for improved understanding of data; (1) the utilization of multiple human senses to interact with and interpret data, and (2) the dual use of language and vision to improve information understanding.
Document Details
- Document Type
- Technical Report
- Publication Date
- Apr 01, 2004
- Accession Number
- ADA427920
Entities
People
- David L. Hall
- Timothy S. Shaw
Organizations
- Pennsylvania State University