A System Approach to Adaptive Multi-Modal Sensor Designs
Abstract
We propose a system approach to adaptive multimodal sensor designs. This approach is based on the integration of tools for the physics-based simulation of complex scenes and targets, sensor modeling, and multimodal data exploitation. The goal is to reduce development time and system cost while achieving optimal results through an iterative process that incorporates simulation, sensing, processing and evaluation. A Data Process Management Architecture (DPMA) is designed, which is a software system that provides a team development environment and a structured operational platform for systems that require many interrelated and coordinated steps. As a case study, we use an effective peripheral-fovea design as an example. This design is inspired by the biological vision systems for achieving real-time target detection and recognition with a hyperspectral/range fovea and panoramic peripheral view. Under the principle of the system approach and performance-driven sensing, a real multimodal human signature detection sensing design is proposed and a test prototype is developed to capture visual, audio and range information at a large distance
Document Details
- Document Type
- Technical Report
- Publication Date
- Feb 01, 2010
- Accession Number
- ADA528562
Entities
People
- Harvey E. Rhody
- Zhigang Zhu
Organizations
- City College of New York