Bibliography (46):

1. Gwern.net newsletter (Substack subscription page)

2. ​ ‘newsletter’ directory

3. ​ Changelog

4. Gwern Branwen Creating Essays on Gwern.net

5. ​ Review Of Crumb

6. https://www.science.org/doi/10.1126/science.adn0117

7. OpenAI Departures: Why Can’t Former Employees Talk, but the New ChatGPT Release Can?

8. OpenAI NDAs: Leaked Documents Reveal Aggressive Tactics toward Former Employees

9. Afterword to Vernor Vinge’s novel, True Names

10. Machine Learning as a Tool for Hypothesis Generation

11. The carbon emissions of writing and illustrating are lower for AI than for humans

12. ML Scaling subreddit

13. https://epochai.org/blog/the-longest-training-run

14. The Effects of Moore’s Law and Slacking on Large Computations

15. TinyStories: How Small Can Language Models Be and Still Speak Coherent English?

16. Meet Shakey: the first electronic person—the fascinating and fearsome reality of a machine with a mind of its own

17. Revisiting Highleyman's Data

18. The Saga of Highleyman 1961’s Data

19. MLPs Learn In-Context

20. Genetic influences on depression and selection into adverse life experiences

21. Heresy, witchcraft, Jean Gerson, scepticism and the use of placebo controls

22. How 3M Discovered, Then Concealed, the Dangers of Forever Chemicals

23. The Persistence and Transience of Memory

24. The fading memories of youth: The mystery of ‘infantile amnesia’ suggests memory works differently in the developing brain

25. Islands of Genius: Artistic brilliance and a dazzling memory can sometimes accompany autism and other developmental disorders

26. Inside the Mind of a Savant: Kim Peek—the inspiration for Rain Main—possesses one of the most extraordinary memories ever recorded. Until we can explain his abilities, we cannot pretend to understand human cognition

27. The Legend of John Von Neumann

28. https://www.newyorker.com/books/page-turner/the-mystery-of-s-the-man-with-an-impossible-memory

29. Crows ‘count’ the number of self-generated vocalizations

30. Effects of Semaglutide on Chronic Kidney Disease in Patients with Type 2 Diabetes

31. General knowledge norms: Updated and expanded from the Nelson & Narens 1980 norms

32. Electric Fields Elicit Ballooning in Spiders

33. Leaked SpaceX documents show company forbids employees to sell stock if it deems they’ve misbehaved: ‘An act of dishonesty against the company’ is among the violations cited

34. https://publicdomainreview.org/essay/early-androids-and-artificial-speech/

35. http://contemporary-home-computing.org/prof-dr-style/

36. https://www.newyorker.com/science/annals-of-medicine/how-ecmo-is-redefining-death

37. https://www.reddit.com/r/TOUHOUMUSIC/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

38. https://www.reddit.com/r/Vocaloid/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

39. Wikipedia Bibliography:

    1. Neural scaling law  :

       https://en.wikipedia.org/wiki/Neural_scaling_law

    2. 3M  :

       https://en.wikipedia.org/wiki/3M

    3. Perfluorooctanesulfonic acid  :

       https://en.wikipedia.org/wiki/Perfluorooctanesulfonic_acid

    4. Rare earths trade dispute

    5. Kim Peek

    6. Paris syndrome

    7. Cardiopulmonary bypass  :

       https://en.wikipedia.org/wiki/Cardiopulmonary_bypass

    8. Crumb (film)