Bibliography (111):

1. Gwern.net newsletter (Substack subscription page)

2. ​ January 2020 News

3. ​ ‘newsletter’ directory

4. ​ Changelog

5. Gwern Branwen Creating Essays on Gwern.net

6. Crowdsourcing The Best GPT-2-1.5b Poetry

7. LinkArchive.hs

8. SingleFile

9. Markdeep Features: Admonitions

10. Markdeep Features: Multiple Columns

11. Markdeep

12. Auto-smallcaps filter

13. ​ Design Graveyard

14. The behavioral, cellular and immune mediators of HIV-1 acquisition: New insights from population genetics

15. The transcriptional legacy of developmental stochasticity

16. Nature Versus Nurture? Add ‘Noise’ to the Debate: We Give Our Genes and Our Environment All the Credit for Making Us Who We Are. But Random Noise during Development Might Be a Deciding Factor, Too.

17. Childhood Adoption and Mental Health in Adulthood: The Role of Gene-Environment Correlations and Interactions in the UK Biobank

18. Is population structure in the genetic biobank era irrelevant, a challenge, or an opportunity?

19. The Evolution of Sex Ratio Distorter Suppression Affects a 25 cM Genomic Region in the Butterfly Hypolimnas bolina

20. A Step Toward Quantifying Independently Reproducible Machine Learning Research

21. Quantifying Independently Reproducible Machine Learning

22. AI Helps Warehouse Robots Pick Up New Tricks: Backed by machine learning luminaries, Covariant.ai’s bots can handle jobs previously needing a human touch

23. Transformers as Soft Reasoners over Language

24. Turing-NLG: A 17-billion-parameter language model by Microsoft

25. T5: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

26. MegatronLM: Training Billion+ Parameter Language Models Using GPU Model Parallelism

27. ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

28. Mesh-TensorFlow: Deep Learning for Supercomputers

29. A Constructive Prediction of the Generalization Error Across Scales

30. Deep Learning Scaling is Predictable, Empirically

31. Measuring the Effects of Data Parallelism on Neural Network Training

32. How AI Training Scales

33. Scaling Laws for Neural Language Models

34. The messy, secretive reality behind OpenAI’s bid to save the world: The AI moonshot was founded in the spirit of transparency. This is the inside story of how competitive pressure eroded that idealism

35. GPT-3: Language Models are Few-Shot Learners

36. REALM: Retrieval-Augmented Language Model Pre-Training

37. REALM: Integrating Retrieval into Language Representation Models

38. How Much Knowledge Can You Pack Into the Parameters of a Language Model?

39. Growing Neural Cellular Automata: Differentiable Model of Morphogenesis

40. https://news.ycombinator.com/item?id=22300376

41. Explorable Explanations

42. Explorable Explanations

43. It's Nicky Case!

44. https://www.reddit.com/r/explorables/

45. How the Horrific 1918 Flu Spread Across America: The toll of history’s worst epidemic surpasses all the military deaths in World War I and World War II combined. And it may have begun in the United States

46. A Sea Story: One of the worst maritime disasters in European history took place a decade ago. It remains very much in the public eye. On a stormy night on the Baltic Sea, more than 850 people lost their lives when a luxurious ferry sank below the waves. From a mass of material, including official and unofficial reports and survivor testimony, our correspondent has distilled an account of the Estonia’s last moments—part of his continuing coverage for the magazine of anarchy on the high seas

47. This Is Why Your Holiday Travel Is Awful: The long, sordid history of New York’s Penn Station shows how progressives have made it too hard for the government to do big things—and why, believe it or not, Robert Caro is to blame

48. The reality and evolutionary [importance] of human psychological sex differences

49. https://x.com/jurijfedorov/status/1225214491744489474

50. Greater male than female variability in regional brain structure across the lifespan

51. Typologies of extreme longevity myths

52. Was Jeanne Calment the Oldest Person Who Ever Lived—or a Fraud? Some researchers have cast doubt on the record of the celebrated supercentenarian

53. ​ Open Questions § Jeanne Calment

54. A simple procedure for the long-term cultivation of chicken embryos

55. A Novel Shell-less Culture System for Chick Embryos Using a Plastic Film as Culture Vessels

56. Physical activity and weight following car ownership in Beijing, China: quasi-experimental cross sectional study

57. Perceptual convergence of multi-component mixtures in olfaction implies an olfactory white

58. In the 1970s, the CIA Created a Robot Dragonfly Spy. Now We Know How It Works. Newly released documents show how the CIA created one of the world’s first examples of insect robotics.

59. ‘The intelligence coup of the century’: For decades, the CIA read the encrypted communications of allies and adversaries

60. All the money in the world couldn’t make Kinect happen: For a moment a decade ago, the game industry looked like a very different place

61. Old CSS, New CSS

62. https://news.ycombinator.com/item?id=22215931

63. Predicting the outcome of roulette

64. Lawrence Bragg’s role in the development of sound-ranging in World War I

65. Judge Judy Is Still Judging You: For more than 20 years, Judith Sheindlin has dominated daytime ratings—by making justice in a complicated world look easy

66. Anesthetizing the Public Conscience: Lethal Injection and Animal Euthanasia

67. I-zombies: The Hard Problem of Unconsciousness

68. ​ Evolution As Backstop for Reinforcement Learning: Pain Is the Only School-Teacher

    [Transclude the forward-link's context]

69. Why you can’t make a computer that feels pain

70. A Martian Sends a Postcard Home [with commentary]

71. Does Who You Are at 7 Determine Who You Are at 63?: In 1964, with Seven Up! Michael Apted stumbled into making what has become the most profound documentary series in the history of cinema. 55 years later, the project is reaching its conclusion.

72. The fascinating and ego-killing existence of human wormholes

73. Explain XKCD #1393: "Timeghost"

74. The Great Buenos Aires Bank Heist: They were an all-star crew. They cooked up the perfect plan. And when they pulled off the caper of the century, it made them more than a fortune—it made them folk heroes.

75. Visions of the Future: 14 space travel posters of colorful, exotic space settings are now available free for downloading and printing

76. https://unesdoc.unesco.org/ark:/48223/pf0000220391

77. ​ Book Reviews § The Hye Ch’O Diary: Memoir of the Pilgrimage to the Five Regions of India, Hyecho1984

78. ​ movie#apollo-11

    [Transclude the forward-link's context]

79. ​ opera#porgy-and-bess

    [Transclude the forward-link's context]

80. George Frideric Handel, Agrippina: Live In HD

81. ​ opera#agrippina

    [Transclude the forward-link's context]

82. Wikipedia Bibliography:

    1. Nine-banded armadillo  :

       https://en.wikipedia.org/wiki/Nine-banded_armadillo

    2. Fisher's principle

    3. Pieter Abbeel  :

       https://en.wikipedia.org/wiki/Pieter_Abbeel

    4. Explorable explanation  :

       https://en.wikipedia.org/wiki/Explorable_explanation

    5. Spanish flu

    6. MS Estonia  :

       https://en.wikipedia.org/wiki/MS_Estonia

    7. Normalcy bias  :

       https://en.wikipedia.org/wiki/Normalcy_bias

    8. Tragedy of the anticommons

    9. Propaganda Due  :

       https://en.wikipedia.org/wiki/Propaganda_Due

    10. Artificial womb  :

        https://en.wikipedia.org/wiki/Artificial_womb

    11. Laser microphone  :

        https://en.wikipedia.org/wiki/Laser_microphone

    12. Lithium nitrate  :

        https://en.wikipedia.org/wiki/Lithium_nitrate

    13. Bimetallic strip  :

        https://en.wikipedia.org/wiki/Bimetallic_strip

    14. Federal Intelligence Service  :

        https://en.wikipedia.org/wiki/Federal_Intelligence_Service

    15. Crypto AG

    16. Kinect

    17. Worse is better

    18. Artillery sound ranging  :

        https://en.wikipedia.org/wiki/Artillery_sound_ranging

    19. Judy Sheindlin  :

        https://en.wikipedia.org/wiki/Judy_Sheindlin

    20. Judge Judy  :

        https://en.wikipedia.org/wiki/Judge_Judy

    21. Craig Raine  :

        https://en.wikipedia.org/wiki/Craig_Raine

    22. Martian poetry  :

        https://en.wikipedia.org/wiki/Martian_poetry

    23. Defamiliarization

    24. Michael Apted  :

        https://en.wikipedia.org/wiki/Michael_Apted

    25. Up (film series)  :

        https://en.wikipedia.org/wiki/Up_(film_series)

    26. Hyecho  :

        https://en.wikipedia.org/wiki/Hyecho

    27. Apollo 11 (2019 film)  :

        https://en.wikipedia.org/wiki/Apollo_11_(2019_film)

    28. Apollo 11  :

        https://en.wikipedia.org/wiki/Apollo_11

    29. Porgy and Bess  :

        https://en.wikipedia.org/wiki/Porgy_and_Bess

    30. Agrippina (opera)