Bibliography (7):

1. Attention Is All You Need

2. https://arxiv.org/pdf/2310.13061#page=2

3. https://arxiv.org/pdf/2310.13061#page=5

4. Decoupled Weight Decay Regularization

5. Wikipedia Bibliography:

   1. Ridge regression § Tikhonov regularization  :

      https://en.wikipedia.org/wiki/Ridge_regression#Tikhonov_regularization

   2. Batch normalization

   3. Dilution (neural networks)