Bibliography (4):

  1. https://github.com/ejmichaud/grokking-squared

  2. Decoupled Weight Decay Regularization

  3. https://arxiv.org/pdf/2205.10343#page=14