Scene Recognition with Infrared, Low-Light, and Sensor-Fused Imagery
Abstract
The goal of this study was to evaluate the information conveyed by single- and dual-band sensor imagery by assessing performance on a scene recognition task. An experiment tested immediate recognition for pictures following an initial brief viewing. Images were taken with an uncooled LIMIRS long-wave infrared sensor and a Fairchild image intensified low-light CCD, and were compared against fused, false-color images created by remapping both spectral bands into a two-dimensional color space (Scribner et al., 1996). In each trial, an image was presented for 100 msec and followed immediately by a 300-msec checkerboard mask. A second image, of the same or of a different sensor format, was then displayed and remained visible until a response was made. The observer's task was to indicate whether the first and second image depicted the same scene, regardless of which sensor format the scenes were displayed in. All possible permutations of sensor formats were used. It was hypothesized that color- fusion, which combined and potentially enhanced information contained in the single-band images, would allow more accurate scene recognition. Performance was best when the first and second images were presented in the same format. When format changed between the presentation of the two images, performance deteriorated, but more so when the second image was of a single band format. Format of the first image itself had little effect, indicating that the primary benefits of sensor fusion were in matching the content of the second image to a stored representation of the first, and not in processing the briefly viewed first image. These results suggest that fusion can allow information from multiple single- band sensors to be effectively combined and presented within a single image, within which component information remains perceptually accessible.
Document Details
- Document Type
- Technical Report
- Publication Date
- Feb 01, 1999
- Accession Number
- ADA390305
Entities
People
- Jason S. Mccarley
- Michael J. Sinai
- William K. Krebs
Organizations
- Naval Postgraduate School