Bibliography (20):

1. Attention Is All You Need

2. ImageNet Large Scale Visual Recognition Challenge

3. One Epoch Is All You Need

4. Scaling Laws for Neural Language Models

5. GPT-3: Language Models are Few-Shot Learners

6. Epigrams on Programming

7. Book from the Ground

8. https://www.emojidick.com/

9. https://evjang.com/2021/12/17/lang-generalization.html

10. Do As I Can, Not As I Say (SayCan): Grounding Language in Robotic Affordances

11. https://arxiv.org/pdf/2010.14701.pdf#page=25

12. https://arxiv.org/pdf/2010.14701.pdf#page=4

13. 2020-henighan-figure3-domainmodelsizescaling.png

14. 2020-henighan-figure11-pretrainingimageclassificationscaling.png

15. Wikipedia Bibliography:

    1. Neural scaling law  :

       https://en.wikipedia.org/wiki/Neural_scaling_law

    2. Cross-entropy

    3. Power law

    4. Entropy (information theory)

    5. Loss function

    6. Ridge regression § Tikhonov regularization  :

       https://en.wikipedia.org/wiki/Ridge_regression#Tikhonov_regularization