Recurrent neural network reveals transparent objects through scattering media

Abstract

Scattering generally worsens the condition of inverse problems, with the severity depending on the statistics of the refractive index gradient and contrast. Removing scattering artifacts from images has attracted much work in the literature, including recently the use of static neural networks. S. Li et al. [Optica 5(7), 803 (2018)10.1364/OPTICA.5.000803] trained a convolutional neural network to reveal amplitude objects hidden by a specific diffuser; whereas Y. Li et al. [Optica 5(10), 1181 (2018)10.1364/OPTICA.5.001181] were able to deal with arbitrary diffusers, as long as certain statistical criteria were met. Here, we propose a novel dynamical machine learning approach for the case of imaging phase objects through arbitrary diffusers. The motivation is to strengthen the correlation among the patterns during the training and to reveal phase objects through scattering media. We utilize the on-axis rotation of a diffuser to impart dynamics and utilize multiple speckle measurements from different angles to form a sequence of images for training. Recurrent neural networks (RNN) embedded with the dynamics filter out useful information and discard the redundancies, thus quantitative phase information in presence of strong scattering. In other words, the RNN effectively averages out the effect of the dynamic random scattering media and learns more about the static pattern. The dynamical approach reveals transparent images behind the scattering media out of speckle correlation among adjacent measurements in a sequence. This method is also applicable to other imaging applications that involve any other spatiotemporal dynamics.

Document Details

Document Type
Pub Defense Publication
Publication Date
Feb 04, 2021
Source ID
10.1364/oe.412890

Entities

People

  • George Barbastathis
  • Iksung Kang
  • Nicholas X. Fang
  • Qihang Zhang
  • Subeen Pang

Organizations

  • Intelligence Advanced Research Projects Activity
  • Korea Foundation for Advanced Studies
  • Massachusetts Institute of Technology
  • Singapore-MIT Alliance for Research and Technology

Tags

Fields of Study

  • Physics

Readers

  • Electromagnetic Wave Scattering and Antenna Radiation Engineering
  • Medical Imaging.
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - Neural Networks