Infrared object classification with a hybrid optical convolution neural network

Abstract

Recent advancements in machine vision have enabled a great range of applications from image classification to autonomous driving. However, there is still a dilemma between the pursuit of higher-resolution training images that require a detector array with more pixels on the front end, and the demands on acquisition for embedded systems restrained by power, transmission bandwidth, and storage. In this paper, a multi-pixel hybrid optical convolutional neural network machine vision system was designed and validated to perform high-speed infrared object detection. The proposed system replicates the front convolution layer in a convolutional neural network utilizing a high-speed digital micro-mirror device to display the first layer of kernels at a resolution greater than the subsequent detector. After this, further convolutions are carried out in software to perform the object recognition. An infrared vehicle dataset was used to validate the performance of the hybrid system through simulation. We also tested this in hardware by performing infrared classification on toy vehicles to showcase the feasibility of such a design.

Document Details

Document Type
Pub Defense Publication
Publication Date
Aug 13, 2021
Source ID
10.1364/ao.427973

Entities

People

  • Jennifer Talley
  • Jianbo Chen
  • Kevin F. Kelly

Organizations

  • Air Force Research Laboratory
  • HID Global
  • Rice University

Tags

Readers

  • Computer Vision.
  • Integrated Circuit Design and Technology.
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • AI & ML - Neural Networks