Bibliography (146):

1. Gwern.net newsletter (Substack subscription page)

2. ​ September 2021 News

3. ​ ‘newsletter’ directory

4. ​ Changelog

5. Gwern Branwen Creating Essays on Gwern.net

6. ​ ‘AlphaFold’ directory

7. ​ ‘CLIP’ directory

8. ​ ‘DALL·E’ directory

9. ​ ‘Jukebox’ directory

10. ​ ‘model-based RL’ directory

11. ​ ‘AlphaGo’ directory

12. ​ ‘MuZero’ directory

13. ​ ‘AI chess’ directory

14. ​ ‘chess psychology’ directory

15. ​ ‘Decision Transformer’ directory

16. ​ ‘MARL’ directory

17. ​ ‘hidden-information game’ directory

18. ​ ‘poker AI’ directory

19. ​ ‘Diplomacy AI’ directory

20. ​ ‘Hanabi AI’ directory

21. ​ ‘OA5’ directory

22. ​ ‘AlphaStar’ directory

23. ​ ‘RL exploration’ directory

24. ​ ‘robotics’ directory

25. ​ ‘adversarial examples (AI)’ directory

26. ​ ‘MoE NN’ directory

27. ​ ‘AI emergence’ directory

28. ​ ‘diffusion model’ directory

29. ​ ‘video generation’ directory

30. ​ ‘video analysis’ directory

31. ​ ‘RNN’ directory

32. ​ ‘Transformer’ directory

33. ​ ‘MLP NN’ directory

34. ​ ‘BigGAN’ directory

35. ​ ‘Codex’ directory

36. ​ ‘inner monologue (AI)’ directory

37. ​ ‘text style transfer’ directory

38. ​ ‘tabular ML’ directory

39. ​ ‘brain imitation learning’ directory

40. ​ ‘meta-learning’ directory

41. ​ ‘preference learning’ directory

42. ​ ‘AI safety’ directory

43. ​ ‘experience curve’ directory

44. ​ ‘text game’ directory

45. ​ ‘music’ directory

46. ​ ‘cellular automata’ directory

47. ​ ‘cloning’ directory

48. ​ ‘gametogenesis’ directory

49. ​ ‘genome synthesis’ directory

50. ​ ‘adoption studies’ directory

51. ​ ‘rare mutations’ directory

52. ​ ‘genome sequencing’ directory

53. ​ ‘microbiome’ directory

54. ​ ‘index selection (breeding)’ directory

55. ​ ‘fasting’ directory

56. ​ ‘semaglutide’ directory

57. ​ ‘tirzepatide’ directory

58. ​ ‘epigenetics (aging)’ directory

59. ​ ‘senolytic’ directory

60. ​ ‘marijuana’ directory

61. ​ ‘psychedelics’ directory

62. ​ ‘meditation’ directory

63. ​ ‘illusion-of-depth bias’ directory

64. ​ ‘inner-monologue (psych)’ directory

65. ​ ‘novelty U-curve’ directory

66. ​ ‘smelling’ directory

67. ​ ‘willpower’ directory

68. ​ ‘mental energy’ directory

69. ​ ‘short sleepers’ directory

70. ​ ‘dog’ directory

71. ​ ‘dog genetics’ directory

72. ​ ‘dog cloning’ directory

73. ​ ‘preference falsification’ directory

74. ​ ‘survival analysis’ directory

75. ​ ‘cryonics’ directory

76. ​ ‘carbon capture’ directory

77. ​ ‘self-sinking waste disposal’ directory

78. ​ ‘Digital Antiquarian’ directory

79. ​ ‘PD Review’ directory

80. ​ ‘data visualization’ directory

81. ​ ‘typography’ directory

82. ​ ‘crime’ directory

83. Magnetic control of tokamak plasmas through deep reinforcement learning

84. ML Scaling subreddit

85. Program Synthesis with Large Language Models

86. Evaluating Large Language Models Trained on Code

87. LaMDA: Our Breakthrough Conversation Technology

88. Show Your Work: Scratchpads for Intermediate Computation with Language Models

89. Program Induction by Rationale Generation: Learning to Solve and Explain Algebraic Word Problems

90. The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models

91. CoCa: Contrastive Captioners are Image-Text Foundation Models

92. Here’s a Link to My Colab If You’d like to Give It a Go Yourself. This Codebase Builds off of Previous Work from Many People including @advadnoun @RiversHaveWings @NerdyRodent as well as ClipDraw from @kvfrans @crosslabstokyo @err_more and @okw

93. CLIPIT PixelDraw Demo

94. CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoders

95. Projected GANs Converge Faster

96. Make Every Feature Binary: A 135B Parameter Sparse Neural Network for Massively Improved Search Relevance

97. Partial success in closing the gap between human and machine vision

98. Evaluating Machine Accuracy on ImageNet

99. When does dough become a bagel? Analyzing the remaining mistakes on ImageNet

100. What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers

101. Deepmind Technologies Limited: Report and Financial Statements Year Ended 31 December 2020 [Full Accounts] § Pg3

102. M6–10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining

103. Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters

104. Adolescent cannabis use and adult psychoticism: A longitudinal co-twin control analysis using data from two cohorts

105. How Long Does It Take Ordinary People To "Get Good" At Chess?

106. Did we find a copycat? ‘Do as I Do’ in a domestic cat (Felis catus)

107. Speed-accuracy trade-off in plants

108. Wet mammals shake at tuned frequencies to dry

109. #FridayPhysicsFun—I Got a Question from the Ever Awesome @Gwern: Shaking off Water from Spoons and Dishes, Does It Actually Dry Them Faster Than Just Letting It Drip in Constant Gravity? What about Dropping Them?

110. Direct Voluntary Control of Pupil Constriction and Dilation: Exploratory Evidence from Pupillometry, Optometry, Skin Conductance, Perception, and Functional MRI

111. AIR-FI: Generating Covert Wi-Fi Signals from Air-Gapped Computers

112. GSMem: Data Exfiltration from Air-Gapped Computers over GSM Frequencies

113. BitWhisper: Covert Signaling Channel between Air-Gapped Computers Using Thermal Manipulations

114. https://buttondown.com/hillelwayne/archive/syntax-highlighting-is-a-waste-of-an-information/

115. Ditherpunk—The Article I Wish I Had about Monochrome Image Dithering

116. https://fontsinuse.com/typefaces/40498/ed-interlock

117. Hangulatin EN Font

118. https://luc.devroye.org/fonts-78250.html

119. https://www.designmadeingermany.de/2013/61882/

120. https://x.com/incunabula/status/1573222769978114048

121. Square Word Calligraphy

122. https://commons.wikimedia.org/wiki/File:ISIL_Caliphate_Seal.svg

123. https://commons.wikimedia.org/wiki/File:SUN_microsystems_logo_ambigram.png

124. https://www.typotheque.com/articles/calcula

125. https://typographica.org/typeface-reviews/calcula/

126. What is the Commons Worth? Estimating the Value of Wikimedia Imagery by Observing Downstream Use

127. Digitization and the Demand for Physical Works: Evidence from the Google Books Project

128. ​ ‘copyright’ directory

129. Potterian Economics

130. The Theory Of Interstellar Trade

131. Should subscription-based content creators display their earnings on crowdfunding platforms? Evidence from Patreon

132. https://www.reddit.com/r/TOUHOUMUSIC/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

133. https://www.reddit.com/r/Vocaloid/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

134. Wikipedia Bibliography:

     1. Neural scaling law  :

        https://en.wikipedia.org/wiki/Neural_scaling_law

     2. Naver

     3. Kuaishou  :

        https://en.wikipedia.org/wiki/Kuaishou

     4. Clonally transmissible cancer

     5. Human echolocation

     6. Impossible color  :

        https://en.wikipedia.org/wiki/Impossible_color

     7. Rich black  :

        https://en.wikipedia.org/wiki/Rich_black

     8. Impossible color § Chimerical colors  :

        https://en.wikipedia.org/wiki/Impossible_color#Chimerical_colors

     9. Air gun § History  :

        https://en.wikipedia.org/wiki/Air_gun#History

     10. Hangul

     11. Xu Bing

     12. Kufic § Square Kufic  :

         https://en.wikipedia.org/wiki/Kufic#Square_Kufic

     13. Vyaz (Cyrillic calligraphy)  :

         https://en.wikipedia.org/wiki/Vyaz_(Cyrillic_calligraphy)