Bibliography (117):

1. Gwern.net newsletter (Substack subscription page)

2. ​ August 2021 News

3. ​ ‘newsletter’ directory

4. ​ Changelog

5. Gwern Branwen Creating Essays on Gwern.net

6. ​ The Math of Hunting Lions

7. [SIGGRAPH Asia 2021] DeepVecFont: Synthesizing High-Quality Vector Fonts via Dual-Modality Learning

8. How Does AI Improve Human Decision-Making? Evidence from the AI-Powered Go Program

9. Welcome to State of AI Report 2021

10. Achieving Human Parity on Visual Question Answering

11. Transformers are Meta-Reinforcement Learners

12. PFNs: Transformers Can Do Bayesian Inference

13. Generate Images from Texts. In Russian

14. The Greatest Remaining Hits

15. https://ooo.ghostbows.ooo/about/

16. Making This Album With AI ‘Felt like Wandering in an Enormous Labyrinth’: Shadow Planet Is the Result of a Three-Way Collaboration between Humans and AI

17. https://ooo.ghostbows.ooo/story/

18. https://github.com/EdZ543/This-Catgirl-Does-Not-Exist

19. ML Scaling subreddit

20. Collaborating with Humans without Human Data

21. A Recipe For Arbitrary Text Style Transfer with Large Language Models

22. Story Centaur: Large Language Model Few Shot Learning As a Creative Writing Tool

23. ​ GPT-3 Creative Fiction § Literary Parodies

    [Transclude the forward-link's context]

24. A Review of Text Style Transfer using Deep Learning

25. The Bitter Lesson

26. Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

27. MAE: Masked Autoencoders Are Scalable Vision Learners

28. Visible Thoughts Project and Bounty Announcement

29. LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs

30. CoAtNet: Marrying Convolution and Attention for All Data Sizes

31. Turing Bletchley: A Universal Image Language Representation Model by Microsoft

32. Vector-quantized Image Modeling with Improved VQGAN

33. Autoregressive Latent Video Prediction with High-Fidelity Image Generator

34. Effect of scale on catastrophic forgetting in neural networks

35. On the Opportunities and Risks of Foundation Models

36. A Universal Law of Robustness via Isoperimetry

37. https://x.com/SebastienBubeck/status/1402645428504461319

38. A Universal Law of Robustness

39. ​ scaling-hypothesis#blessings-of-scale

    [Transclude the forward-link's context]

40. Why Robust Generalization in Deep Learning is Difficult: Perspective of Expressive Power

41. On the Predictability of Pruning Across Scales

42. ​ ‘NN sparsity’ directory

43. Sparse is Enough in Scaling Transformers

44. What Are Bayesian Neural Network Posteriors Really Like?

45. Greedy Hierarchical Variational Autoencoders (GHVAEs) for Large-Scale Video Prediction

46. https://wandb.ai/dalle-mini/dalle-mini/reports/DALL-E-mini--Vmlldzo4NjIxODA

47. DALL·E 1: Creating Images from Text: We’ve trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural language

48. Multimodal Few-Shot Learning with Frozen Language Models

49. AudioCLIP: Extending CLIP to Image, Text and Audio

50. Google Demonstrates Leading Performance in Latest MLPerf Benchmarks

51. Time-Aware Language Models as Temporal Knowledge Bases

52. Genetic risk factors have a substantial impact on healthy life years

53. Novel disease associations with schizophrenia genetic risk revealed in ~400,000 UK Biobank participants

54. Does parental education influence child educational outcomes? A developmental analysis in a full-population sample and adoptee design

55. Using genes to explore the effects of cognitive and non-cognitive skills on education and labor market outcomes

56. The contribution of additive genetic variation to personality variation: heritability of personality

57. Uncovering the Genetic Architecture of Broad Antisocial Behavior through a Genome-Wide Association Study Meta-analysis.

58. Genome-wide association analyses of individual differences in quantitatively assessed reading-related and language-related skills in up to 34,000 people

59. Identifying a Living Great-Grandson of the Lakota Sioux Leader Tatanka Iyotake (Sitting Bull)

60. Global Biobank Meta-analysis Initiative: powering genetic discovery across human diseases

61. https://academic.oup.com/nsr/article/8/6/nwaa175/5893295

62. Facultative Parthenogenesis in California Condors

63. Sigmoids behaving badly: why they usually cannot predict the future as well as they seem to promise

64. Maths Writer/cowritter Needed: How You Can’t Distinguish Early Exponential from Early Sigmoid

65. Why Sigmoids Are so Hard to Predict

66. Forecasting S-Curves Is Hard

67. Predicting the Future With Data+logistic Regression

68. Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

69. Gender Identity, Coworking Spouses and Relative Income within Households

70. The Razor Blade in the Apple: The Social Construction of Urban Legends

71. Obesity of politicians and corruption in post-Soviet countries

72. Rule Enforcement Without Visible Means: Christmas Gift Giving in Middletown

73. https://harpers.org/archive/2021/04/lost-in-thought-psychological-risks-of-meditation/

74. Remembering immunity: Neuronal ensembles in the insular cortex encode and retrieve specific immune responses

75. The Brain Can Recall and Reawaken Past Immune Responses: The Brain Not Only Helps to Regulate Immune Responses, but Also Stores and Retrieves ‘Memories’ of Them

76. Erosion of the Epigenetic Landscape and Loss of Cellular Identity as a Cause of Aging in Mammals

77. Making sense of the ageing methylome

78. Blood-based epigenome-wide analyses of cognitive abilities

79. A collective analysis of lifespan-extending compounds in diverse model organisms, and of species whose lifespan can be extended the most by the application of compounds

80. A New Way to Be Mad

81. Echolocating bats rely on an innate speed-of-sound reference

82. Attractor and integrator networks in the brain

83. Reality shifting: psychological features of an emergent online daydreaming culture

84. Nothing Ventured, Nothing Gained: Parasite Infection is Associated with Entrepreneurial Initiation, Engagement, and Performance

85. Escape of hair follicle stem cells causes stem cell exhaustion during aging

86. Synthetic fat from petroleum as a resilient food for global catastrophes: Preliminary techno-economic assessment and technology roadmap

87. David Denkenberger on Using Paper Mills and Seaweed to Feed Everyone in a Catastrophe, Ft Sahil Shah

88. 2005: Shades of Doom

89. Toshi Omagari

90. ToughSF: Anti-Orbit Laser Submarines

91. Is this the simplest (and most surprising) sorting algorithm ever?

92. How inefficient can a sort algorithm be?

93. Coolex: The coolest way to generate combinations

94. Choices Are Really Bad

95. The science of cycology: Failures to understand how everyday objects work

96. Donors Vastly Underestimate Differences in Charities’ Effectiveness

97. https://www.uliwestphal.de/elephas-anthropogenus/index.html

98. Elephas anthropogenus

99. Distinguishing Real Vs. Fake Tiger Penises [Identification Guides for Wildlife Law Enforcement #6]

100. https://www.reddit.com/r/TOUHOUMUSIC/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

101. https://www.reddit.com/r/Vocaloid/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

102. Wikipedia Bibliography:

     1. Neural scaling law  :

        https://en.wikipedia.org/wiki/Neural_scaling_law

     2. Sitting Bull  :

        https://en.wikipedia.org/wiki/Sitting_Bull

     3. Heliox  :

        https://en.wikipedia.org/wiki/Heliox

     4. Doom (1993 video game)  :

        https://en.wikipedia.org/wiki/Doom_(1993_video_game)

     5. Microtypography

     6. Ink trap  :

        https://en.wikipedia.org/wiki/Ink_trap

     7. Detonator (railway)  :

        https://en.wikipedia.org/wiki/Detonator_(railway)

     8. Insertion sort

     9. Scunthorpe problem  :

        https://en.wikipedia.org/wiki/Scunthorpe_problem

     10. Zvi Mowshowitz  :

         https://en.wikipedia.org/wiki/Zvi_Mowshowitz

     11. Spanish Christmas Lottery  :

         https://en.wikipedia.org/wiki/Spanish_Christmas_Lottery

     12. Hotelling’s law

     13. Norton's dome  :

         https://en.wikipedia.org/wiki/Norton%27s_dome

     14. Emmanuel Barthélemy  :

         https://en.wikipedia.org/wiki/Emmanuel_Barth%C3%A9lemy

     15. Napoleon III  :

         https://en.wikipedia.org/wiki/Napoleon_III

     16. Paradise Lost