Bibliography (115):

1. Gwern.net newsletter (Substack subscription page)

2. ​ January 2021 News

3. ​ ‘newsletter’ directory

4. ​ Changelog

5. Gwern Branwen Creating Essays on Gwern.net

6. Controllable Neural Text Generation

7. This Article Provides an Overview of Recent Methods to Fine-Tune Large Pre-Trained Language Models

8. Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm

9. Calibrate Before Use: Improving Few-Shot Performance of Language Models

10. ​ GPT-3 Creative Fiction § Prompts As Programming

11. TransGAN: Two Transformers Can Make One Strong GAN

12. Proof Artifact Co-training for Theorem Proving with Language Models

13. Generative Language Modeling for Automated Theorem Proving

14. Towards End-to-End In-Image Neural Machine Translation

15. The Learning Algorithm That Enables the Runaway Success of Deep Neural Networks Doesn’t Work in Biological Brains, but Researchers Are Finding Alternatives That Could

16. Theories of Error Back-Propagation in the Brain

17. Meta Learning Backpropagation And Improving It

18. A massive 7T fMRI dataset to bridge cognitive and computational neuroscience

19. Brain2Pix: Fully convolutional naturalistic video reconstruction from brain activity

20. A large single-participant fMRI dataset for probing brain responses to naturalistic stimuli in space and time

21. High-performance brain-to-text communication via imagined handwriting

22. Brain-computer interface for generating personally attractive images

23. ML Scaling subreddit

24. Scaling Laws for Transfer

25. ALIGN: Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision

26. Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts

27. CLIP: Connecting Text and Images: We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the ‘zero-shot’ capabilities of GPT-2 and GPT-3

28. Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers

29. The Bitter Lesson

30. Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Images

31. CW-VAE: Clockwork Variational Autoencoders

32. Image Completion via Inference in Deep Generative Models

33. Generating Images with Sparse Representations

34. WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training

35. Zero-Shot Text-to-Image Generation

36. DALL·E 1: Creating Images from Text: We’ve trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural language

37. M6: A Chinese Multimodal Pretrainer

38. Explaining Neural Scaling Laws

39. Learning Curve Theory

40. [AN #140]: Theoretical Models That Predict Scaling Laws

41. Phenotypic covariance across the entire spectrum of relatedness for 86 billion pairs of individuals

42. Genetic variation, brain, and intelligence differences

43. Pathfinder: A gamified measure to integrate general cognitive ability into the biological, medical and behavioral sciences

44. Genomic prediction of cognitive traits in childhood and adolescence

45. Polygenic burden has broader impact on health, cognition, and socioeconomic outcomes than most rare and high-risk copy number variants

46. Ditching candidate gene association studies: lessons from psychiatric genetics

47. Million-Year-Old DNA Rewrites the Mammoth Family Tree: Genomic data—the oldest ever recovered from a fossil—reveals the origin and evolution of the Columbian mammoth

48. Kin selection explains the evolution of cooperation in the gut microbiota

49. Meet Elizabeth Ann, the First Cloned Black-Footed Ferret: Her birth represents the first cloning of an endangered species native to North America, and may bring needed genetic diversity to the species

50. https://www.lesswrong.com/posts/9YDk52NPrfq7nqLvd/lessons-from-the-book-of-my-life

51. ​ Newton’s System of the World and Comets

52. ​ Origins of Innovation: Bakewell & Breeding

53. ​ book#the-autobiography-of-benvenuto-cellini-cellini-1999

    [Transclude the forward-link's context]

54. How Many Microcovids Would You Spend on a Burrito?

55. https://www.microcovid.org/

56. ​ index#piffles

    [Transclude the forward-link's context]

57. Artifact and Recording Concepts in EEG

58. ​ Fashion Cycles

59. The Logic of Fashion Cycles

60. Fashion and art cycles are driven by counter-dominance signals of elite competition: quantitative evidence from music styles

61. The hipster effect: When anticonformists all look the same

62. Right Is The New Left

63. Signaling Status with Luxury Goods: The Role of Brand Prominence

64. Up and down with ecology—the ‘issue-attention cycle’

65. Anthony Downs, ‘Up and Down with Ecology: The ‘Issue-Attention’ Cycle’

66. Accelerating dynamics of collective attention

67. The universal decay of collective memory and attention

68. Self-Censorship in Public Discourse: A Theory of ‘Political Correctness’ and Related Phenomena

69. What Can We Learn from the Lunar Pandemic That Never Was?

70. How MrBeast Became the Willy Wonka of YouTube

71. Social Status: Down the Rabbit Hole

72. Russia’s new Lysenkoism

73. Lessons from the host defences of bats, an unique viral reservoir

74. Why do human beings keep getting diseases from bats?

75. Beneficial and Detrimental Effects of Reactive Oxygen Species on Lifespan: A Comprehensive Review of Comparative and Experimental Studies

76. Positive expectations predict improved mental-health outcomes linked to psychedelic microdosing

77. The Effects of Fluoride in Drinking Water

78. Sleep and sex: what can go wrong? A review of the literature on sleep related disorders and abnormal sexual behaviors and experiences

79. Once-Weekly Semaglutide in Adults with Overweight or Obesity

80. Effect of Subcutaneous Semaglutide vs Placebo as an Adjunct to Intensive Behavioral Therapy on Body Weight in Adults With Overweight or Obesity: The STEP 3 Randomized Clinical Trial

81. Safety and pharmacokinetics of single and multiple ascending doses of the novel oral human GLP-1 analogue, oral semaglutide, in healthy subjects and subjects with type 2 diabetes

82. Semaglutide 2.4 mg for the Treatment of Obesity: Key Elements of the STEP Trials 1 to 5

83. Comparative efficacy, safety, and cardiovascular outcomes with once-weekly subcutaneous semaglutide in the treatment of type 2 diabetes: Insights from the SUSTAIN 1–7 trials

84. Management Of Endocrine Disease: Are all GLP-1 agonists equal in the treatment of type 2 diabetes?

85. Efficacy and safety of semaglutide compared with liraglutide and placebo for weight loss in patients with obesity: a randomized, double-blind, placebo and active controlled, dose-ranging, phase 2 trial

86. Effects of once-weekly semaglutide on appetite, energy intake, control of eating, food preference and body weight in subjects with obesity

87. A Phase 2, Randomized, Dose-Finding Study of the Novel Once-Weekly Human GLP-1 Analog, Semaglutide, Compared With Placebo and Open-Label Liraglutide in Patients With Type 2 Diabetes

88. Discovery of the Once-Weekly Glucagon-Like Peptide-1 (GLP-1) Analogue Semaglutide

89. Society Is Fixed, Biology Is Mutable

90. Overview XPRIZE Carbon Removal

91. Why Did Renewables Become so Cheap so Fast?

92. IQ, trading behavior, and performance

93. Genetic Endowments and Wealth Inequality

94. ​ ‘ethicists’ directory

95. The Behavior of Ethicists

96. The moral behavior of ethics professors: A replication-extension in German-speaking countries

97. Meta-analysis on belief in free will manipulations

98. Caesar Lives

99. Wikipedia Bibliography:

    1. Lean (proof assistant)

    2. Electroencephalography

    3. Jell-O  :

       https://en.wikipedia.org/wiki/Jell-O

    4. Scientific control § Negative  :

       https://en.wikipedia.org/wiki/Scientific_control#Negative

    5. MrBeast  :

       https://en.wikipedia.org/wiki/MrBeast

    6. Bat virome  :

       https://en.wikipedia.org/wiki/Bat_virome

    7. Semaglutide

    8. Liraglutide

    9. Gauge block  :

       https://en.wikipedia.org/wiki/Gauge_block

    10. Armoured train  :

        https://en.wikipedia.org/wiki/Armoured_train

    11. Experience curve effects

    12. Cooperative principle

    13. Bunnies & Burrows  :

        https://en.wikipedia.org/wiki/Bunnies_%26_Burrows

    14. Iggy Pop  :

        https://en.wikipedia.org/wiki/Iggy_Pop

    15. The History of the Decline and Fall of the Roman Empire

    16. Grayanotoxin § Mad honey intoxication  :

        https://en.wikipedia.org/wiki/Grayanotoxin#Mad_honey_intoxication

    17. Imperial Court System  :

        https://en.wikipedia.org/wiki/Imperial_Court_System