Bibliography (56):

  1. Gwern.net newsletter (Substack subscription page)

  2. ​ June 2023 News

  3. ​ ‘newsletter’ directory

  4. ​ Changelog

  5. Gwern Branwen Creating Essays on Gwern.net

  6. ​ Absolute Unit NNs: Regression-Based MLPs for Everything

  7. ​ Language-Conditioned Absolute Unit NNs

  8. ​ Modular Brain AUNNs for Uploads

  9. Even Superhuman Go AIs Have Surprising Failure Modes

  10. https://restofworld.org/2023/ai-revolution-outsourced-workers/

  11. ML Scaling subreddit

  12. https://www.nytimes.com/2023/07/12/magazine/semiconductor-chips-us-china.html

  13. ChinAI #56: The Sour Past of "China Chips"

  14. China's Censors Are Afraid of ChatGPT

  15. China Says Chatbots Must Toe the Party Line: The Communist Party outlined draft rules that would set guardrails on the rapidly growing industry of services like ChatGPT

  16. https://www.foreignaffairs.com/china/illusion-chinas-ai-prowess-regulation-helen-toner

  17. The 26-year-old CEO who became Washington’s AI whisperer

  18. How Large-Language Models Can Revolutionize Military Planning

  19. https://www.lesswrong.com/posts/z4MDDwwnWKnv2ZzdK/the-agi-race-between-the-us-and-china-doesn-t-exist

  20. https://www.vox.com/future-perfect/23794855/anthropic-ai-openai-claude-2

  21. Scaling laws for language encoding models in fMRI

  22. Stability AI Launches SDXL 0.9: A Leap Forward in AI Image Generation

  23. SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis

  24. SDXL § Micro-Conditioning: Conditioning the Model on Image Size

  25. Teaching Arithmetic to Small Transformers

  26. Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression

  27. How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?

  28. Solving math word problems with process & outcome-based feedback

  29. The Vanishing Family: They all have a 50-50 chance of inheriting a cruel genetic mutation—which means disappearing into dementia in middle age. This is the story of what it’s like to live with those odds

  30. Evolution of a minimal cell

  31. Best Practices: Formal Proofs, the Fine Print and Side Effects

  32. We Could Have Universal COVID Vaccines Very Soon

  33. Peltzman Revisited: Quantifying 21st-Century Opportunity Costs of FDA Regulation

  34. Triple-Hormone-Receptor Agonist Retatrutide for Obesity—A Phase 2 Trial

  35. Retatrutide, a GIP, GLP-1 and glucagon receptor agonist, for people with type 2 diabetes: a randomized, double-blind, placebo and active-controlled, parallel-group, phase 2 trial conducted in the USA

  36. Tirzepatide once weekly for the treatment of obesity in people with type 2 diabetes (SURMOUNT-2): a double-blind, randomized, multicenter, placebo-controlled, phase 3 trial

  37. A leaky integrate-and-fire computational model based on the connectome of the entire adult Drosophila brain reveals insights into sensorimotor processing

  38. Sleep Deprivation Sometimes Relieves Depression. A New Study May Show Why

  39. https://www.nytimes.com/2014/03/09/magazine/reaching-my-autistic-son-through-disney.html

  40. https://www.newyorker.com/magazine/2023/07/31/larry-gagosian-profile

  41. A Controversial Rare-Book Dealer Tries to Rewrite His Own Ending

  42. Not Everyone Has an Inner Voice: Behavioral Consequences of Anendophasia

  43. https://skunkledger.substack.com/p/escaping-high-school

  44. https://blog.ploeh.dk/2017/10/04/from-design-patterns-to-category-theory/

  45. https://www.nature.com/articles/s41586-022-04910-y

  46. https://github.com/KeeyanGhoreshi/PokemonFireredSingleSequence

  47. Can You Beat Pokemon FireRed While Blind and Deaf?

  48. Why it hurts: with freedom comes the biological need for pain

  49. ​ movie#streets-of-fire

    [Transclude the forward-link's context]

  50. https://www.reddit.com/r/TOUHOUMUSIC/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

  51. https://www.reddit.com/r/Vocaloid/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

  52. Wikipedia Bibliography:

    1. Neural scaling law  :

      https://en.wikipedia.org/wiki/Neural_scaling_law

    2. Patrick Collison

    3. Nanocar Race  :

      https://en.wikipedia.org/wiki/Nanocar_Race

    4. Pokémon FireRed and LeafGreen  :

      https://en.wikipedia.org/wiki/Pok%C3%A9mon_FireRed_and_LeafGreen

    5. Streets of Fire