Bibliography (11):

1. https://x.com/sangmichaelxie/status/1660909587070095360

2. Distributionally Robust Language Modeling

3. https://pile.eleuther.ai/

4. GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

5. The Pile: An 800GB Dataset of Diverse Text for Language Modeling

6. https://arxiv.org/pdf/2305.10429.pdf#page=22&org=google

7. Wikipedia Bibliography:

   1. https://en.wikipedia.org/wiki/Wikipedia  :

      https://en.wikipedia.org/wiki/Wikipedia

   2. https://en.wikipedia.org/wiki/Language_model  :

      https://en.wikipedia.org/wiki/Language_model

   3. Spearman's rank correlation coefficient

   4. Entropy (information theory)

   5. Prior probability