Achieving small-batch accuracy with large-batch scalability via Hessian-aware learning rate adjustment

Document Details

Document Type
Pub Defense Publication
Publication Date
Jan 01, 2023
Source ID
10.1016/j.neunet.2022.11.007

Entities

People

  • A. Salman Avestimehr
  • Chaoyang He
  • Sunwoo Lee

Organizations

  • Defense Advanced Research Projects Agency
  • Inha University
  • Intel Corporation
  • Qualcomm
  • United States Department of Defense