Bibliography (118):

  1. Gwern.net newsletter (Substack subscription page)

  2. May 2024 News

  3. ‘newsletter’ tag

  4. Changelog

  5. Gwern Branwen Creating Essays on Gwern.net

  6. On the Impossibility of Superintelligent Rubik’s Cube Solvers

  7. Review Of The Last Unicorn

  8. Statistical Notes § Best Student Ever!

  9. Representation Engineering: A Top-Down Approach to AI Transparency

  10. https://www.nature.com/articles/s41586-023-06419-4

  11. Creativity Has Left the Chat: The Price of Debiasing Language Models

  12. https://www.reddit.com/r/reinforcementlearning/comments/1dhkn9o/creativity_has_left_the_chat_the_price_of/l8xisr7/

  13. Consistency-diversity-realism Pareto fronts of conditional image generative models

  14. Epistemic Calibration and Searching the Space of Truth

  15. In-context Reinforcement Learning with Algorithm Distillation

  16. Supervised Pretraining Can Learn In-Context Reinforcement Learning

  17. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4553431

  18. Othello is Solved

  19. Solving a Rubik’s Cube in Record Time

  20. Cuboth

  21. ML Scaling subreddit

  22. Machine Learning Scaling

  23. https://chinamediaproject.org/2024/05/27/goldfish-memories/

  24. New AI battle adopts old price war strategy as Chinese tech giants keep start-ups at bay behind the Great Firewall

  25. China Is Losing the Chip War: Xi Jinping picked a fight over semiconductor technology—one he can’t win

  26. For Chinese Students, the New Tactic Against AI Checks: More AI

  27. Research misconduct in China: towards an institutional analysis

  28. Where Does China Stand In the Current AI Wave? China’s top policy experts discuss the US-China gap, open vs. closed, and societal implications

  29. Introducing Claude 3.5

  30. Ilya Sutskever Has a New Plan for Safe Superintelligence: OpenAI’s co-founder discloses his plans to continue his work at a new research lab focused on artificial general intelligence

  31. Google’s DeepMind-Brain merger: tech giant regroups for AI battle

  32. AI Deception: A Survey of Examples, Risks, and Potential Solutions

  33. Hoodwinked: Deception and Cooperation in a Text-Based Game for Language Models

  34. https://www.pnas.org/doi/full/10.1073/pnas.2317967121

  35. Reward Hacking Behavior Can Generalize across Tasks

  36. Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models

  37. A Theory for Emergence of Complex Skills in Language Models

  38. A Solvable Model of Neural Scaling Laws

  39. https://www.lesswrong.com/posts/Nsmabb9fhpLuLdtLE/takeoff-speeds-presentation-at-anthropic

  40. Trading Off Compute in Training and Inference

  41. Robust agents learn causal world models

  42. A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Task

  43. https://www.quantamagazine.org/how-ai-revolutionized-protein-science-but-didnt-end-it-20240626/

  44. No Physics? No Problem. AI Weather Forecasting Is Already Making Huge Strides.

  45. Probing the Decision Boundaries of In-context Learning in Large Language Models

  46. Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations (HSTU)

  47. MTOB: A Benchmark for Learning to Translate a New Language from One Grammar Book

  48. Market Concentration Implications of Foundation Models

  49. MIT Researchers Ordered and Combined Parts of the 1918 Pandemic Influenza Virus. Did They Expose a Security Flaw?

  50. Meet Orchid, the First Whole Genome Embryo Reports

  51. 1972 Talk at CERN on Scientific Research

  52. Scientists Who Fund Themselves

  53. Why Fake Miniatures Depicting Islamic Science Are Everywhere

  54. Quantifying the Potential Persuasive Returns to Political Microtargeting

  55. The Beliefs of the Blob

  56. Why the State Department’s INR Intelligence Agency May Be the Best in DC

  57. Intergenerational Mobility in American History: Accounting for Race and Measurement Error

  58. The Unexpected Origins of a Modern Finance Tool

  59. https://www.journals.uchicago.edu/doi/10.1086/728594

  60. Samsara

  61. Language is primarily a tool for communication rather than thought

  62. Testing the structure of human cognitive ability using evidence obtained from the impact of brain lesions over abilities

  63. Goodbye, Ozempic: A new class of drugs is transforming obesity care. They are not all the same

  64. ‘Skinny jabs’: weight-loss drugs set for new boom as generic liraglutide versions emerge

  65. Social status and unethical behavior: Two replications of the field studies in Piff et al 2012

  66. A Cause-of-Death Decomposition of Young Adult Excess Mortality

  67. https://www.nippon.com/en/japan-topics/c12403/

  68. The Cells That Eat, Regurgitate and Eat Your Tattoos Again

  69. Unveiling skin macrophage dynamics explains both tattoo persistence and strenuous removal

  70. True Porn Clerk Stories

  71. The Titan Submersible Disaster Shocked the World. The Exclusive Inside Story Is More Disturbing Than Anyone Imagined

  72. The Turing Complete User

  73. https://labyrinthlocator.org/

  74. The Valve.Computer: A Modern 8-Bit Design, Built Using 1950s Thermionic Valves

  75. https://fellerts.no/projects/kintsugi.html

  76. The Battleships Game That Countered German U-Boat Attacks During WW2

  77. https://www.chm.bris.ac.uk/motm/motm.htm

  78. Microsoft Refused to Fix Flaw Years Before SolarWinds Hack

  79. The Gender Gap in Confidence: Expected but Not Accounted For

  80. From Fire Hazards to Family Trees: The Sanborn Fire Insurance Maps

  81. All That Is Solid Bursts into Flame: Capitalism and Fire in the 19th-Century United States

  82. Animator Supporters Project Posts Toshio Okada’s Criticisms of Production Committee System with English Subtitles

  83. Can Poetry Matter?

  84. The Golden Boy

  85. Watchmaker [Watchmen, Chapter 4]

  86. Extreme D&D DIY: Adventures in Hypergeometry, Procedural Generation, and Software Development (part 1)

  87. Claire Jordan homepage

  88. A True Original

  89. Fanon versus Canon

  90. The Inheritance of Magic

  91. Musui’s Story: The Autobiography of a Tokugawa Samurai

  92. Mediocre Samurai Describes Real Life in Historical Japan

  93. book#the-autobiography-of-benvenuto-cellini-cellini-1999

    [Transclude the forward-link's context]

  94. book#the-japanese-family-storehouse-ihara-1959

    [Transclude the forward-link's context]

  95. The Minds of Psychopaths

  96. ‘Mother’

  97. Blue-And-Orange Morality

  98. Review Of The Last Unicorn

  99. https://www.reddit.com/r/TOUHOUMUSIC/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

  100. https://www.reddit.com/r/Vocaloid/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

  101. Wikipedia Bibliography:

    1. Speedcubing  :

    2. Kasparov versus the World  :

    3. Alexander Grothendieck  :

    4. Wikipedia:Requests for comment/Jagged 85/Evidence  :

    5. Historia Augusta  :

    6. Bureau of Intelligence and Research (INR)  :

    7. Rex Nemorensis  :

    8. Adragon De Mello  :

    9. Titan submersible implosion  :

    10. Oslo Report  :

    11. Western Approaches Tactical Unit  :

    12. Dana Gioia  :

    13. John Nettleship  :

    14. Katsu Kokichi  :

    15. Frieren  :

    16. Odd Taxi  :

    17. Blindsight (Watts novel)  :

    18. The Last Unicorn (film)  :