Bibliography (186):

1. Gwern.net newsletter (Substack subscription page)

2. ​ May 2021 News

3. ​ ‘newsletter’ directory

4. ​ Changelog

5. Gwern Branwen Creating Essays on Gwern.net

6. LinkAuto.hs

7. Pandoc-Discuss

8. ​ Startup Ideas

9. ​ startup-idea#indoor-tree-climbing-gym

   [Transclude the forward-link's context]

10. ​ startup-idea#mouse-longevity-perpetual-swaps

    [Transclude the forward-link's context]

11. ​ startup-idea#streamer-memorabilia

    [Transclude the forward-link's context]

12. ​ The Scaling Hypothesis

13. ​ GPT-3 Nonfiction

14. ​ Efficient Attention: Breaking The Quadratic Transformer Bottleneck

15. ​ ‘MLP NN’ directory

16. ​ ‘NN sparsity’ directory

17. ​ ARPA and SCI: Surfing AI

18. ​ Technology Forecasting: The Garden of Forking Paths

19. ​ ‘tech economics’ directory

20. ​ ‘Portia spider’ directory

21. ​ ‘end-to-end’ directory

22. ​ Computer Optimization: Your Computer Is Faster Than You Think

23. ​ On Seeing Through and Unseeing: The Hacker Mindset

24. ​ How Many Computers Are In Your Computer?

25. ​ The sort –key Trick

26. ​ Design Of This Website

27. ​ Design Of This Website § Returns To Design?

28. ​ Self-Blinded Mineral Water Taste Test

29. ​ Leaky Pipelines

30. ​ Regression To The Mean Fallacies

31. ​ ‘Fermi problems’ directory

32. ​ Origins of Innovation: Bakewell & Breeding

33. ​ Cat Psychology & Domestication: Are We Good Owners?

34. ​ Race in My Little Pony

35. ​ ‘emergenesis’ directory

36. ​ Variance Components Beyond Genetics

37. ​ ‘Anne Roe’s Scientists’ directory

38. ​ McNamara’s Folly: The Denial of Individual Differences

39. ​ ‘IQ & SES’ directory

40. ​ Ordinary Incompetence

41. ​ Lizardman Constant in Surveys

42. ​ The Effectiveness of Unreasonable Small Groups

43. ​ Review Of The Cultural Revolution, Dikötter 2016

44. ​ The Second Apocalypse: Freedom In An Unfree Universe

45. ​ Fashion Cycles

46. ​ ‘ethicists’ directory

47. ​ Parasocial Relationships Online

48. ​ Abandoned Footnotes

49. ​ Leprechaun Hunting & Citogenesis

50. ​ Origin of ‘Littlewood’s Law of Miracles’

51. ​ Progress In Beauty

52. ​ Why Cats Love Earwax

53. ​ Does Mouse Utopia Exist?

54. ​ Falling & Head Injuries

55. ​ ‘Johan Bjorksten (aging)’ directory

56. ​ ‘copyright’ directory

57. ​ Local Optima & Greedy Choices

58. ​ The Exploding Nash 2-Of-2 NashX Equilibrium

59. ​ Frank P. Ramsey Bibliography

60. ​ Anime Reviews

61. ​ Umineko: The Hopium Of The Magics

62. ​ Book Reviews

63. ​ Movie Reviews

64. Vector Quantized Models for Planning

65. Building AGI Using Language Models

66. Stochastic MuZero: Planning in Stochastic Environments with a Learned Model

67. Playing Nondeterministic Games through Planning with a Learned Model

68. FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

69. A Graph Placement Methodology for Fast Chip Design

70. AI System Outperforms Humans in Designing Floorplans for Microchips: A Machine-Learning System Has Been Trained to Place Memory Blocks in Microchip Designs. The System Beats Human Experts at the Task, and Offers the Promise of Better, More-Rapidly Produced Chip Designs Than Are Currently Possible

71. The Robot Household Marathon Experiment

72. It’s (Still) Really Hard for Robots to Autonomously Do Household Chores

73. The rise of intelligent matter

74. GANs N’ Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)

75. GANs-N-Roses: Diverse Im2im and Vid2vid Selfie to Anime Translation.

76. Alias-Free Generative Adversarial Networks

77. 2021-karras-aliasfreegan-afhq-3-interpolation.mp4

78. https://nvlabs.github.io/alias-free-gan/

79. Efficient Geometry-Aware 3D Generative Adversarial Networks

80. https://arxiv.org/pdf/1912.01865#page=9

81. What A Long, Strange Trip It’s Been: EleutherAI One Year Retrospective

82. https://www.reddit.com/r/Futurology/comments/oqriew/we_are_eleutherai_a_decentralized_research/

83. We Are Conjecture, A New Alignment Research Startup

84. Alien Dreams: An Emerging Art Scene

85. Tour of the Sacred Library

86. ML Scaling subreddit

87. ​ ‘video generation’ directory

88. Imagen Video

89. Dreamix: Video Diffusion Models are General Video Editors

90. Phenaki

91. https://parti.research.google/

92. W.A.L.T: Photorealistic Video Generation with Diffusion Models

93. https://research.google/blog/videopoet-a-large-language-model-for-zero-shot-video-generation/

94. Make-A-Video

95. MAGVIT: Masked Generative Video Transformer

96. https://wilsonyan.com/teco/

97. NUWA-∞: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis

98. NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion

99. TATS: Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer

100. THUDM/CogVideo: Text-To-Video Generation. The Repo for ICLR2023 Paper ‘CogVideo: Large-Scale Pretraining for Text-To-Video Generation via Transformers’

101. Flexible Diffusion Modeling of Long Videos

102. Table A

103. Video Diffusion Models

104. Large Language Models are Zero-Shot Reasoners

105. ​ ‘inner monologue (AI)’ directory

106. CodeT: Code Generation with Generated Tests

107. A Conversational Paradigm for Program Synthesis

108. Solving Quantitative Reasoning Problems with Language Models

109. Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification

110. Faithful Reasoning Using Large Language Models

111. ReAct: Synergizing Reasoning and Acting in Language Models

112. Challenging BIG-Bench Tasks (BBH) and Whether Chain-of-Thought Can Solve Them

113. Large Language Models Can Self-Improve

114. Unsupervised Neural Machine Translation with Generative Language Models Only

115. PAL: Program-aided Language Models

116. Language Models are Multilingual Chain-of-Thought Reasoners

117. Interactive-Chain-Prompting (INTERCPT): Ambiguity Resolution for Crosslingual Conditional Generation with Interaction

118. Self-Ask: Measuring and Narrowing the Compositionality Gap in Language Models (Bamboogle)

119. q2d: Turning Questions into Dialogs to Teach Models How to Search

120. Think Before You Act: Unified Policy for Interleaving Language Reasoning with Actions

121. Teaching Models to Express Their Uncertainty in Words

122. Language Models (Mostly) Know What They Know

123. https://github.com/features/copilot/

124. Microsoft and OpenAI have a new AI tool that will give coding suggestions to software developers

125. Evaluating Large Language Models Trained on Code

126. Tabnine AI Code Assistant

127. IntelliCode Compose: Code Generation Using Transformer

128. Research recitation: A first look at rote learning in GitHub Copilot suggestions

129. This Fursona Does Not Exist

130. ​ Fashion Cycles

131. Decision Transformer: Reinforcement Learning via Sequence Modeling

132. https://aider.chat/docs/unified-diffs.html

133. Epigrams on Programming

134. Genetics of Substance Use Disorders in the Era of Big Data

135. Whole-exome imputation within UK Biobank powers rare coding variant association and fine-mapping analyses

136. Aurea Smigrodzki: The First Baby in History to Be Conceived With the Help of Polygenic Testing

137. Rank Ordering Embryos for Transfer, Utilizing PGT-P: Patient and Clinician Perspectives

138. Welcome Polygenically Screened Babies

139. Polygenic Embryo Screening: Comments on Carmi Et Al and Visscher Et Al

140. Picking Embryos With Best Health Odds Sparks New DNA Debate: Science Could Allow Parents to Select for Taller, Smarter Kids; It’s Just Another Way of Preventing Disease

141. https://podcasts.google.com/feed/aHR0cHM6Ly9yc3MuYWNhc3QuY29tL2Rhbm55aW50aGV2YWxsZXk/episode/MDI4NDI4ODMtZmE3YS00MzA2LTk1ZGItZjgzZDdlMzAwZThk

142. https://www.youtube.com/watch?v=LiciNlrc3sE

143. A New Age of Genetic Screening Is Coming—And We Don’t Have Any Rules for It: New ‘Polygenic’ Screening Techniques Open a Pandora’s Box of Ethical Issues

144. CRISPR-Cas9 In Vivo Gene Editing for Transthyretin Amyloidosis

145. ​ ‘gametogenesis’ directory

146. Artificially produced gametes in mice, humans and other species

147. Gametes from stem cells: Status and applications in animal reproduction

148. In Vitro Breeding: Application of Embryonic Stem Cells to Animal Production

149. Danish Dairy Farmers’ Acceptance of and Willingness to Use Semen from Bulls Produced by means of in Vitro Embryo Production and Genomic Selection

150. What We Learned Doing Fast Grants

151. COVID ‘Fast Grants’ Sped up Pandemic Science: Programme Awarded $US50 Million in Rapid Grants and Highlights Limitations in Existing Scientific-Funding Mechanisms

152. Introducing Arc Institute

153. Shifting the Impossible to the Inevitable

154. Do Meta-Analyses Oversell the Longer-Term Effects of Programs? (Part 1): Detecting Follow-Up Selection Bias in Studies of Postsecondary Education Programs

155. Do multiple experimenters improve the reproducibility of animal studies?

156. Test & Roll: Profit-Maximizing A/B Tests

157. Gaussian Belief Propagation

158. STATISTICAL INQUIRIES INTO THE EFFICACY OF PRAYER

159. Get Lucky

160. Air Pollution and Adult Cognition: Evidence from Brain Training

161. https://www.nejm.org/doi/full/10.1056/NEJMoa2030243

162. https://www.nature.com/articles/s41467-019-13192-4

163. Human click-based echolocation: Effects of blindness and age, and real-life implications in a 10-week training program

164. The Scavenging Patterns of Feral Cats on Human Remains in an Outdoor Setting

165. 5 Years of Graduate CS Education Online and at Scale

166. Salary Negotiation: Make More Money, Be More Valued

167. How Not to Bomb Your Offer Negotiation

168. Harris’s List of Covent-Garden Ladies (1757–95)

169. Wikipedia Bibliography:

     1. Neural scaling law  :

        https://en.wikipedia.org/wiki/Neural_scaling_law

     2. James Gurney  :

        https://en.wikipedia.org/wiki/James_Gurney

     3. Beam search

     4. Autocomplete  :

        https://en.wikipedia.org/wiki/Autocomplete

     5. Transformative use  :

        https://en.wikipedia.org/wiki/Transformative_use

     6. Diff

     7. Command-line completion

     8. Belief propagation

     9. Bayesian network

     10. 1989 California medfly attack  :

         https://en.wikipedia.org/wiki/1989_California_medfly_attack

     11. Dark Harvest Commando  :

         https://en.wikipedia.org/wiki/Dark_Harvest_Commando

     12. Jet injector  :

         https://en.wikipedia.org/wiki/Jet_injector

     13. Georgia Tech

     14. Georgia Tech Online Master of Science in Computer Science  :

         https://en.wikipedia.org/wiki/Georgia_Tech_Online_Master_of_Science_in_Computer_Science

     15. Meteor burst communications  :

         https://en.wikipedia.org/wiki/Meteor_burst_communications

     16. Kapitza’s pendulum  :

         https://en.wikipedia.org/wiki/Kapitza%27s_pendulum

     17. Harris's List of Covent Garden Ladies  :

         https://en.wikipedia.org/wiki/Harris%27s_List_of_Covent_Garden_Ladies

     18. Cummingtonite  :

         https://en.wikipedia.org/wiki/Cummingtonite