Bibliography (161):

  1. Gwern.net newsletter (Substack subscription page)

  2. ​ July 2021 News

  3. ​ ‘newsletter’ directory

  4. ​ Changelog

  5. Gwern Branwen Creating Essays on Gwern.net

  6. ​ The ‘Screwfly Solution’ Solution: Bi-Sexuality

  7. ​ Open Questions § Fetish Economics

  8. Mastering Atari Games with Limited Data

  9. MuZero: Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model

  10. Procedural Generalization by Planning with Self-Supervised World Models

  11. Procgen Benchmark: We’re releasing Procgen Benchmark, 16 simple-to-use procedurally-generated environments which provide a direct measure of how quickly a reinforcement learning agent learns generalizable skills

  12. Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning

  13. DORA: No-Press Diplomacy from Scratch

  14. Human-Level Performance in No-Press Diplomacy via Equilibrium Search

  15. Monkey Plays Pac-Man with Compositional Strategies and Hierarchical Decision-making

  16. Monkeys Play Pac-Man

  17. Fake It Till You Make It: Face analysis in the wild using synthetic data alone

  18. Acquisition of Chess Knowledge in AlphaZero

  19. RASP: Thinking Like Transformers

  20. https://huggingface.co/spaces/mullikine/ilambda

  21. KARASINGER: SCORE-FREE SINGING VOICE SYNTHESIS WITH VQ-VAE USING MEL-SPECTROGRAMS

  22. Percival: Making In-Browser Perceptual Ad Blocking Practical With Deep Learning

  23. Optimizing color for camouflage and visibility using deep learning: the effects of the environment and the observer’s visual system

  24. ML Scaling subreddit

  25. Open-Ended Learning Leads to Generally Capable Agents

  26. Generally Capable Agents Emerge from Open-Ended Play

  27. Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

  28. Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, the World’s Largest and Most Powerful Generative Language Model

  29. GPT-3: Language Models are Few-Shot Learners

  30. The Pile: An 800GB Dataset of Diverse Text for Language Modeling

  31. Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learning

  32. 2021-10-11-xinzhiyuan-inspursource10gpt245b.html

  33. China Has Already Reached Exascale—On Two Separate Systems

  34. A General Language Assistant as a Laboratory for Alignment

  35. ​ ‘preference learning’ directory

  36. Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned

  37. Recursively Summarizing Books with Human Feedback

  38. Exploring the Limits of Large Scale Pre-training

  39. FLAN: Finetuned Language Models Are Zero-Shot Learners

  40. https://research.google/blog/introducing-flan-more-generalizable-language-models-with-instruction-fine-tuning/

  41. Unsupervised Neural Machine Translation with Generative Language Models Only

  42. Scaling Laws for Neural Machine Translation

  43. Data and Parameter Scaling Laws for Neural Machine Translation

  44. Training Verifiers to Solve Math Word Problems

  45. Solving Math Word Problems: We’ve Trained a System That Solves Grade School Math Problems With Nearly Twice the Accuracy of a Fine-Tuned GPT-3 Model. It Solves about 90% As Many Problems As Real Kids: a Small Sample of 9-12 Year Olds Scored 60% on a Test from Our Dataset, While Our System Scored 55% on Those Same Problems. This Is Important Because Today’s AI Is Still Quite Weak at Commonsense Multistep Reasoning, Which Is Easy Even for Grade School Kids. We Achieved These Results by Training Our Model to Recognize Its Mistakes, so That It Can Try Repeatedly Until It Finds a Solution That Works

  46. ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

  47. 文心大模型-产业级知识增强大模型

  48. Structured Denoising Diffusion Models in Discrete State-Spaces

  49. Beyond In-Place Corruption: Insertion and Deletion In Denoising Probabilistic Models

  50. Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions

  51. Autoregressive Diffusion Models

  52. Step-unrolled Denoising Autoencoders for Text Generation

  53. Zero-Shot Translation using Diffusion Models

  54. Diffusion-LM Improves Controllable Text Generation

  55. LLaDA: Large Language Diffusion Models

  56. The Current Study Made a Huge Jump in the Sample Size from 700k to 5 Million. And It Looks like That Is All It Takes to Explain the Full SNP-h2 (50%). So, the Study Seems to Have Reached It Saturation Phase Where the ~12,000 Genome-Wide Signals Explained the Full H2SNP of Height, Which Is 50% (Note the Rest of 30% of the Twin H2 Is Likely Explained by Rare Variants).

  57. A Saturated Map of Common Genetic Variants Associated with Human Height from 5.4 Million Individuals of Diverse Ancestries

  58. ‘Landmark’ study resolves a major mystery of how genes govern human height

  59. A common variant of HMGA2 is associated with adult and childhood height in the general population

  60. Improving GWAS discovery and genomic prediction accuracy in Biobank data

  61. https://www.nature.com/articles/s41586-021-03855-y

  62. Protein-coding repeat polymorphisms strongly shape diverse human phenotypes

  63. The sequences of 150,119 genomes in the UK biobank

  64. Discovery of 42 Genome-Wide Statistically-Significant Loci Associated with Dyslexia

  65. Somatic mutation rates scale with lifespan across mammals

  66. 100,000 Genomes Pilot on Rare-Disease Diagnosis in Health Care—Preliminary Report

  67. Ultra-Rapid Nanopore Genome Sequencing in a Critical Care Setting

  68. Predicting skeletal stature using ancient DNA

  69. Molecular Support for Heterogonesis Resulting in Sesquizygotic Twinning

  70. A selection pressure landscape for 870 human polygenic traits

  71. Clonal genome evolution and rapid invasive spread of the marbled crayfish

  72. The genetic basis of tail-loss evolution in humans and apes

  73. Spectrum of human tails: A report of six cases

  74. A true human tail in neonate

  75. Conception: How Silicon Valley Hatched a Plan to Turn Blood into Lab-Made Human Eggs

  76. CRISPR Gene-Editing Experiment Partly Restores Vision In Legally Blind Patients

  77. In a First, Surgeons Attached a Pig Kidney to a Human, and It Worked: A kidney grown in a genetically altered pig functions normally, scientists reported. The procedure may open the door to a renewable source of desperately needed organs

  78. Kidneys From a Genetically Altered Pig Are Implanted in a Brain-Dead Patient: Surgeons at the University of Alabama at Birmingham Said They Hoped to Start Clinical Trials With Kidney Patients Later This Year

  79. In a First, Man Receives a Heart From a Genetically Altered Pig

  80. Pig Heart Transplant Failure: Doctors Detail Everything That Went Wrong

  81. https://www.nytimes.com/2024/03/21/health/pig-kidney-organ-transplant.html

  82. https://www.wired.com/story/combined-heart-pump-pig-kidney-transplant-surgery/

  83. A Cure for Type 1 Diabetes? For One Man, It Seems to Have Worked.

  84. Nuclear Fission: Reaction to the Discovery in 1939

  85. Alleged Sins of Science

  86. Don’t Worry—It Can’t Happen

  87. https://80000hours.org/podcast/episodes/tom-moynihan-prior-generations/

  88. Generalizability of heterogeneous treatment effect estimates across samples

  89. An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports

  90. Serendipity: Towards a taxonomy and a theory

  91. Truncating Bar Graphs Persistently Misleads Viewers

  92. Good News on Climate Change

  93. Advice to Young People, As You Face Annihilation

  94. https://www.wired.com/story/stop-telling-kids-theyll-die-from-climate-change/

  95. Genes, Ideology, and Sophistication

  96. Long-term Health and Social Outcomes in Children and Adolescents Placed in Out-of-Home Care

  97. Moral disciplining: the cognitive and evolutionary foundations of puritanical morality

  98. Time-tagged ticker tapes for intracellular recordings

  99. https://x.com/DingchangLin/status/1448809886477860865

  100. Recording of cellular physiological histories along optically readable self-assembling protein chains

  101. Infinite re-reading of single proteins at single-amino-acid resolution using nanopore sequencing

  102. Molecular recording of sequential cellular events into DNA

  103. Multiplex genomic recording of enhancer and signal transduction activity in mammalian cells

  104. A temporally resolved, multiplex molecular recorder based on sequential genome editing

  105. A Multisite Preregistered Paradigmatic Test of the Ego-Depletion Effect

  106. Ego Depletion May Disappear by 2020

  107. Physical principles for scalable neural recording

  108. Can One Concurrently Record Electrical Spikes from Every Neuron in a Mammalian Brain?

  109. Tracking neural activity from the same cells during the entire adult life of mice

  110. Imaging intact human organs with local resolution of cellular structures using hierarchical phase-contrast tomography

  111. Computation in the human cerebral cortex uses less than 0.2 watts yet this great expense is optimal when considering communication costs

  112. Energy compensation and adiposity in humans

  113. The Future of Weight Loss

  114. Anti-obesity drug discovery: advances and challenges

  115. Striking individual differences in color perception uncovered by ‘the dress’ photograph

  116. Asymmetries in blue-yellow color perception and in the color of ‘the dress’

  117. The many colors of ‘the dress’

  118. Illumination assumptions account for individual differences in the perceptual interpretation of a profoundly ambiguous stimulus in the color domain: ‘The dress’

  119. A pathogenic fungus uses volatiles to entice male flies into fatal matings with infected female cadavers

  120. Assessing the calorific importance of episodes of human cannibalism in the Paleolithic

  121. Cannibalism

  122. How Long Could One Survive Eating Yourself?

  123. Blood, sweat, & tears: extraterrestrial regolith biocomposites with In Vivo binders

  124. Preliminary Study Of The Nuclear Subterrene

  125. Those Magnificent Men and Their Atomic Machines: The Atomic Subterrene

  126. The YouTube Revolution in Knowledge Transfer

  127. The Halo Drive: Fuel-Free Relativistic Propulsion of Large Masses via Recycled Boomerang Photons

  128. Neutron tomography of Van Leeuwenhoek’s microscopes

  129. https://ilovetypography.com/2018/08/24/a-brief-history-of-the-index/

  130. Better Eats

  131. The Paper of Record Meets an Ephemeral Web: An Examination of Linkrot and Content Drift within The New York Times

  132. Co-dfns: A data parallel compiler hosted on the GPU § 2.1.4 Idiomatic APL

  133. https://www.pnas.org/doi/10.1073/pnas.2016976118

  134. https://www.happierlivesinstitute.org/uploads/1/0/9/9/109970865/cash_transfer_meta-analysis_working_paper_1.53.pdf#page=2

  135. Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity

  136. Only the Bad Die Young: Restaurant Mortality in the Western US

  137. Why Philosophers Should Care About Computational Complexity

  138. The Psychology of Existential Risk: Moral Judgments about Human Extinction

  139. Language and thought are not the same thing: evidence from neuroimaging and neurological patients

  140. Fundamentally Misunderstanding Visual Perception: Adults’ Belief in Visual Emissions

  141. Laser ablation of human guilt

  142. 2018-08-06-jamieclarke-shovelknightdropcaps.html

  143. https://www.steelypips.org/wotfaq/2_nondark/2.7_generalities/2.7.5_iconography.html

  144. https://wot.fandom.com/wiki/Category:Chapter_art

  145. A Practical Guide to Evil

  146. https://x.com/MooCheese/status/1381635386703773700

  147. The Pink Panthers

  148. Wikipedia Bibliography:

    1. Tail § Human tails  :

      https://en.wikipedia.org/wiki/Tail#Human_tails

    2. Robert Andrews Millikan  :

      https://en.wikipedia.org/wiki/Robert_Andrews_Millikan

    3. Roger Hallam (activist)  :

      https://en.wikipedia.org/wiki/Roger_Hallam_(activist)

    4. Extinction Rebellion  :

      https://en.wikipedia.org/wiki/Extinction_Rebellion

    5. Our World in Data  :

      https://en.wikipedia.org/wiki/Our_World_in_Data

    6. Semaglutide

    7. The dress

    8. Antonie van Leeuwenhoek § Techniques and discoveries  :

      https://en.wikipedia.org/wiki/Antonie_van_Leeuwenhoek#Techniques_and_discoveries

    9. Initial

    10. Shovel Knight  :

      https://en.wikipedia.org/wiki/Shovel_Knight

    11. Robert Jordan  :

      https://en.wikipedia.org/wiki/Robert_Jordan

    12. The Wheel of Time

    13. New London School explosion  :

      https://en.wikipedia.org/wiki/New_London_School_explosion

    14. Pink Panthers  :

      https://en.wikipedia.org/wiki/Pink_Panthers