Fantastic Pretraining Optimizers and Where to Find Them 2.1: Hyperball Optimization

Created on January 02, 2025   ·   11 minute read

2025   ·   weight decay   hyperball   optimization   deep learning   ·   research

This article now lives on Notion. You will be redirected automatically.



Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • Fantastic Pretraining Optimizers and Where to Find Them 2.2: The Hitchhiker's Guide to the Weight Norm Theory