Deep learning for fast spatially varying deconvolution

Abstract

Deconvolution can be used to obtain sharp images or volumes from blurry or encoded measurements in imaging systems. Given knowledge of the system’s point spread function (PSF) over the field of view, a reconstruction algorithm can be used to recover a clear image or volume. Most deconvolution algorithms assume shift-invariance; however, in realistic systems, the PSF varies laterally and axially across the field of view due to aberrations or design. Shift-varying models can be used, but are often slow and computationally intensive. In this work, we propose a deep-learning-based approach that leverages knowledge about the system’s spatially varying PSFs for fast 2D and 3D reconstructions. Our approach, termed MultiWienerNet, uses multiple differentiable Wiener filters paired with a convolutional neural network to incorporate spatial variance. Trained using simulated data and tested on experimental data, our approach offers a 625 − 1600 × increase in speed compared to iterative methods with a spatially varying model, and outperforms existing deep-learning-based methods that assume shift invariance.

Document Details

Document Type
Pub Defense Publication
Publication Date
Jan 12, 2022
Source ID
10.1364/optica.442438

Entities

People

  • Kristina Monakhova
  • Kyrollos Yanny
  • Laura Waller
  • Richard W. Shuai

Organizations

  • Defense Advanced Research Projects Agency
  • Gordon and Betty Moore Foundation
  • National Institutes of Health
  • National Science Foundation
  • University of California

Tags

Readers

  • Image Processing and Computer Vision.
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks