Bibliography (15):

1. In-Context Learning and Induction Heads

2. Universal Transformers

3. Attention Is All You Need

4. D.5: Context Dependence

5. Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context

6. ​ index#ssm

   [Transclude the forward-link's context]

7. Scaling Laws for Acoustic Models

8. Scaling Laws for Autoregressive Generative Modeling

9. Wikipedia Bibliography:

   1. Neural scaling law  :

      https://en.wikipedia.org/wiki/Neural_scaling_law

   2. Cross-entropy

   3. Power law

   4. Long short-term memory

   5. Recurrent neural network

   6. Ridge regression § Tikhonov regularization  :

      https://en.wikipedia.org/wiki/Ridge_regression#Tikhonov_regularization

   7. Entropy (information theory)