Towards Augmented Microscopy with Reinforcement Learning-Enhanced Workflows

Abstract

Here, we report a case study implementation of reinforcement learning (RL) to automate operations in the scanning transmission electron microscopy workflow. To do so, we design a virtual, prototypical RL environment to test and develop a network to autonomously align the electron beam position without prior knowledge. Using this simulator, we evaluate the impact of environment design and algorithm hyperparameters on alignment accuracy and learning convergence, showing robust convergence across a wide hyperparameter space. Additionally, we deploy a successful model on the microscope to validate the approach and demonstrate the value of designing appropriate virtual environments. Consistent with simulated results, the on-microscope RL model achieves convergence to the goal alignment after minimal training. Overall, the results highlight that by taking advantage of RL, microscope operations can be automated without the need for extensive algorithm design, taking another step toward augmenting electron microscopy with machine learning methods.

Document Details

Document Type
Pub Defense Publication
Publication Date
Dec 01, 2022
Source ID
10.1017/s1431927622012193

Entities

People

  • Abinash Kumar
  • James M. LeBeau
  • Michael Xu

Organizations

  • Air Force Office of Scientific Research
  • Massachusetts Institute of Technology

Tags

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Distributed Systems and Data Platform Development
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - Neural Networks
  • Directed Energy
  • Microelectronics
  • Space