Bibliography (132):

  1. Gwern.net newsletter (Substack subscription page)

  2. April 2020 News

  3. ‘newsletter’ directory

  4. Changelog

  5. Gwern Branwen Creating Essays on Gwern.net

  6. Making Anime With BigGAN § Danbooru2019+e621 256px BigGAN

  7. Anime Crop Datasets: Faces, Figures, & Hands § Danbooru2019 Figures

  8. https://groups.google.com/g/hakyll/c/aFH9LHKyDZ8/m/-zY0SHdUBAAJ

  9. Design Graveyard § srcset Mobile Optimization

  10. popups.js

  11. GPT-3: Language Models are Few-Shot Learners

  12. GPT-3 paper § Figure F.1: Four uncurated completions from a context suggesting the model compose a poem in the style of Wallace Stevens with the title ‘Shadows on the Way’

  13. GPT-3 Creative Fiction

  14. GPT-2 Neural Network Poetry

  15. GPT-3 Github JSON Dump Reformatted to Readable HTML

  16. OpenAI API

  17. The Scaling Hypothesis

  18. scaling-hypothesis#human-perplexity

    [Transclude the forward-link's context]

  19. Measuring the Algorithmic Efficiency of Neural Networks

  20. AI and Efficiency: We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has been decreasing by a factor of 2 every 16 months

  21. Danny Hernandez on forecasting and the drivers of AI progress

  22. Solving Real-World Linear Programs: A Decade and More of Progress

  23. Algorithmic Progress in Six Domains

  24. Intelligence Explosion Microeconomics

  25. R2D2: Recurrent Experience Replay in Distributed Reinforcement Learning

  26. IntelliCode Compose: Code Generation Using Transformer

  27. ZeRO-2 & DeepSpeed: Shattering barriers of deep learning speed & scale

  28. GrokNet: Unified Computer Vision Model Trunk and Embeddings For Commerce

  29. Powered by AI: Advancing product understanding and building new shopping experiences

  30. Deep neuroethology of a virtual rodent

  31. AI-Powered Rat Could Be a Valuable New Tool for Neuroscience: Researchers from DeepMind and Harvard are using a virtual rat to see what neural networks can teach us about biology

  32. Go-Explore: First return, then explore

  33. Learning to Simulate Dynamic Environments with GameGAN

  34. Learning to Simulate Dynamic Environments with GameGAN [homepage]

  35. Learning to Simulate Dynamic Environments With GameGAN (CVPR 2020)

  36. Neural Turing Machines

  37. Exploring Bayesian Optimization: Breaking Bayesian Optimization into small, sizeable chunks

  38. This Word Does Not Exist

  39. This Fursona Does Not Exist

  40. This Fursona Does Not Exist—Fursona Editor (Tensorflow Version)

  41. Making Anime Faces With StyleGAN

  42. Artbreeder

  43. The Internet Furry Drama Raising Big Questions About Artificial Intelligence

  44. Local genetic correlation analysis reveals heterogeneous etiologic sharing of complex traits

  45. Identification of 370 genetic loci for age at first sex and birth linked to externalizing behavior

  46. Genome-wide association study of school grades identifies a genetic overlap between language ability, psychopathology and creativity

  47. GWAS of Depression Phenotypes in the Million Veteran Program and Meta-analysis in More than 1.2 Million Participants Yields 178 Independent Risk Loci

  48. A Single Gene Causes Thelytokous Parthenogenesis, the Defining Feature of the Cape Honeybee Apis mellifera capensis

  49. Insights into the genetic architecture of the human face

  50. Sex-biased reduction in reproductive success drives selective constraint on human genes

  51. Genome-wide analysis identifies genetic effects on reproductive success and ongoing natural selection at the FADS locus

  52. Genome-wide analysis identifies 12 loci influencing human reproductive behavior

  53. Mega-analysis of 31,396 individuals from 6 countries uncovers strong gene-environment interaction for human fertility

  54. Sexual dimorphism in the genetic influence on human childlessness

  55. Disentangling selection on genetically correlated polygenic traits using whole-genome genealogies

  56. Recent advances in bovine in vitro embryo production: reproductive biotechnology history and methods

  57. Variability in the analysis of a single neuroimaging dataset by many teams

  58. Remembering John Conway’s FRACTRAN, a ridiculous, yet surprisingly deep language

  59. FRACTRAN: A Simple Universal Programming Language for Arithmetic

  60. Tumbling toast, Murphy’s Law and the fundamental constants

  61. The Science of Murphy’s Law: Life’s little annoyances are not as random as they seem: the awful truth is that the universe is against you

  62. Man’s size in terms of fundamental constants

  63. A closer look at tumbling toast

  64. On the tumbling toast problem

  65. The Voluntariness of Voluntary Consent: Consent Searches and the Psychology of Compliance

  66. It’s All about the Benjamins: An Empirical Study on Incentivizing Users to Ignore Security Advice

  67. Everyday Life as an Intelligence Test: Effects of Intelligence and Intelligence Context § Conspiracy Rumors in Everyday Life

  68. Progress Studies for Aspiring Young Scholars: An online summer program in the history of technology for high school students

  69. Jason Crawford

  70. Understanding Immunity through the Lens of Disease Ecology

  71. Experimental Epidemiology

  72. Experimental Epidemiology

  73. Population biology of infectious diseases: Part I

  74. Population biology of infectious diseases: Part II

  75. Coevolution of hosts and parasites

  76. Experimental Evolution of Parasites

  77. History of Sabin attenuated poliovirus oral live vaccine strains

  78. The Acquired Immune System: A Vantage from Beneath

  79. The Greatest Host

  80. Draining the swamp: How sanitation conquered disease long before vaccines or antibiotics

  81. Everyday Life as an Intelligence Test: Effects of Intelligence and Intelligence Context

  82. Objective and subjective experiences of child maltreatment and their relationships with psychopathology

  83. Brainless but Multi-Headed: Decision Making by the Acellular Slime Mould Physarum polycephalum

  84. I’m paid biweekly, just not by leprechauns: Evaluating valid-but-incorrect response rates to attention check items

  85. ‘Lizardman survey constant’ directory

  86. Reflections on How Designers Design with Data

  87. How Does the Adoption of Ad Blockers Affect News Consumption?

  88. Banner Ads Considered Harmful

  89. The 1-Bit Instrument: The Fundamentals of 1-Bit Synthesis, Their Implementational Implications, and Instrumental Possibilities

  90. In Ohio, the Amish Take On the Coronavirus: A famously traditional community has mobilized to help hospitals with medical supplies, even as it struggles with reconciling its communal way of life with the dictates of social distancing.

  91. The Great Paper Caper: Years of running drugs and boosting cars left Frank Bourassa thinking: There’s got to be an easier way to earn a dishonest living. That’s when he nerved up the idea to make his fortune. (Literally.) Which is how Frank became the most prolific counterfeiter in American history—a guy with more than $200 million in nearly flawless fake twenties stuffed in a garage. How he got away with it all, well, that’s even crazier.

  92. My Immortal As Alchemical Allegory

  93. Dead Reckoning: The 18th century misadventures of HMS Wager and her reluctant crew

  94. https://www.amazon.com/gp/product/1589881427/

  95. Book Reviews § The Battle Between the Frogs and the Mice, Stallings2019

  96. Review Of The Cultural Revolution, Dikötter 2016

  97. https://www.reddit.com/r/TOUHOUMUSIC/search/?q=author%3Agwern&sort=new&restrict_sr=on&t=all

  98. Sept Jours sans Elle (Septette for the Dead Princess)

  99. Une Semaine chez Les Écarlates (Embodiment of Scarlet Devil)

  100. [Touhou Vocal] Raven’s Jig—Un Jour Joueur (Tomboyish Girl in Love)

  101. Bons Et Mauvais Jours (Apparitions Stalk the Night)

  102. II. The Journey [The Quest of the Lost Sapphire—Ep. 2]

  103. Love And Reflection

  104. Ignite

  105. Etherium Apex—Second Prances (Vocal VIP) Ft. Nicole Carino

  106. The Wasteland Wailers—Spun

  107. Carbon Maestro—Equiterian Empire (Celestial Divide OST)

  108. The Storm Is Coming VIP

  109. Mare Cognitum (Feat. Velvet R. Wings)

  110. https://poniesatdawn.bandcamp.com/album/dreamwalkerstrack/fire-city-day-night

  111. What Remains

  112. Anime Jazz Cover

  113. https://www.amazon.com/Anime-Standards-Vol-Platina-Jazz/dp/B07YG536TT

  114. SHINNN—Hope