Bibliography (89):

  1. Gwern.net newsletter (Substack subscription page)

  2. ​ November 2020 News

  3. ​ ‘newsletter’ directory

  4. ​ Changelog

  5. Gwern Branwen Creating Essays on Gwern.net

  6. 2020-12-25-gwern-gwernnet-recursivepopups.png

  7. rewrite.js

  8. Autonomous navigation of stratospheric balloons using reinforcement learning

  9. Image Generators with Conditionally-Independent Pixel Synthesis

  10. ​ ‘MLP NN’ directory

  11. Skeb Artwork Commissioning Website: Review: Commission your favorite Japanese artists with auto-translation

  12. Does Machine Translation Affect International Trade? Evidence from a Large Digital Platform

  13. The 2020s Political Economy of Machine Translation

  14. Object-based attention for spatio-temporal reasoning: Outperforming neuro-symbolic models with flexible distributed architectures

  15. A simple neural network module for relational reasoning

  16. The Bitter Lesson

  17. ML Scaling subreddit

  18. Draft Report on AI Timelines

  19. New Report on How Much Computational Power It Takes to Match the Human Brain

  20. Imitating Interactive Intelligence

  21. 404 - Google DeepMind

  22. Direct Feedback Alignment Provides Learning in Deep Neural Networks

  23. Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures

  24. Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment

  25. Parallel Training of Deep Networks with Local Updates

  26. Pipelined Backpropagation at Scale: Training Large Models without Batches

  27. The Pile: An 800GB Dataset of Diverse Text for Language Modeling

  28. Extrapolating GPT-N performance

  29. CPM: A Large-scale Generative Chinese Pre-trained Language Model

  30. Rare Genetic Variation Underlying Human Diseases and Traits: Results from 200,000 Individuals in the UK Biobank

  31. Ten years of enhancing neuro-imaging genetics through meta-analysis: An overview from the ENIGMA Genetics Working Group

  32. High-throughput, low-cost and rapid DNA sequencing using surface-coating techniques

  33. Efficient phasing and imputation of low-coverage sequencing data using large reference panels

  34. Reprogramming to recover youthful epigenetic information and restore vision

  35. Sight restored by turning back the epigenetic clock: Neurons progressively deteriorate with age and lose resilience to injury. It emerges that treatment with three transcription factors can re-endow neurons in the mature eye with youthful characteristics and the capacity to regenerate

  36. Reversal of Aging via in Vivo Epigenetic Reprogramming

  37. Reconstitution of the oocyte transcriptional network with transcription factors

  38. Eight Proteins Turn Mouse Stem Cells into Egglike Cells: The identification of the transcription factors that elicit oocyte growth will aid reproductive biology research and might help women with fertility issues, scientists say

  39. Biotechnology Research Viewed With Caution Globally, but Most Support Gene Editing for Babies To Treat Disease: Majorities across global publics accept evolution; religion factors prominently in belief

  40. Acceptance of genetic editing and of whole genome sequencing of human embryos by patients with infertility before and after the onset of the COVID-19 pandemic

  41. Is the rate of scientific progress slowing down?

  42. The statistical properties of RCTs and a proposal for shrinkage

  43. The Busy Beaver Frontier

  44. How the Slowest Computer Programs Illuminate Math’s Fundamental Limits: The goal of the ‘busy beaver’ game is to find the longest-running computer program. Its pursuit has surprising connections to some of the most profound questions and concepts in mathematics

  45. How to shuffle a big dataset

  46. Generation of Random Permutations of Given Number of Elements Using Random Sampling Numbers

  47. A Simple Randomization Procedure

  48. Did people really drink bleach to prevent COVID-19? A tale of problematic respondents and a guide for measuring rare events in survey data

  49. ​ Lizardman Constant in Surveys

  50. Digital Voicing of Silent Speech

  51. Real-time Synthesis of Imagined Speech Processes from Minimally Invasive Recordings of Neural Activity

  52. Thinking ahead: prediction in context as a keystone of language in humans and machines

  53. Adversarial images for the primate brain

  54. Neural population control via deep image synthesis

  55. Adversarial Examples that Fool both Computer Vision and Time-Limited Humans

  56. Applying insights from magic to improve deception in research: The Swiss cheese model

  57. Attention and awareness in stage magic: turning tricks into research

  58. The Physics of Space War: How Orbital Dynamics Constrain Space-to-Space Engagements

  59. What Would a Realistic Space Battle Look Like?

  60. Breaking paragraphs into lines

  61. Breaking paragraphs into lines § A Historical Summary

  62. Micro-typographic extensions to the TeX typesetting system

  63. Noise in the landscape: Disputing the visibility of mundane technological objects

  64. https://www.flickr.com/groups/wiredsky/pool/

  65. The Timing of Evolutionary Transitions Suggests Intelligent Life Is Rare

  66. A Secret Vice

  67. 2015-mirante-thesubcreationtheoryofjrrtolkien.html

  68. J. R. R. Tolkien’s sub-creation theory: literary creativity as participation in the divine creation

  69. Tolkien and Darwin Among the Machines

  70. What to Make of Rod McKuen?

  71. The Instagram Poet Outselling Homer 10 to 1: Meet Rupi Kaur, author of the ubiquitous Milk and Honey

  72. Goodreads plans to retire API access, disables existing API keys

  73. ​ Book Reviews

  74. Wikipedia Bibliography:

    1. DeepL Translator

    2. Cyc § OpenCyc  :

      https://en.wikipedia.org/wiki/Cyc#OpenCyc

    3. Wikidata

    4. Graphcore  :

      https://en.wikipedia.org/wiki/Graphcore

    5. BGI Group

    6. Scott Aaronson

    7. External memory algorithm  :

      https://en.wikipedia.org/wiki/External_memory_algorithm

    8. Fisher–Yates shuffle  :

      https://en.wikipedia.org/wiki/Fisher%E2%80%93Yates_shuffle

    9. Intrusive thought

    10. Trypophobia

    11. Marbled crayfish

    12. Microtypography

    13. Polyglot (book)  :

      https://en.wikipedia.org/wiki/Polyglot_(book)

    14. IP over Avian Carriers  :

      https://en.wikipedia.org/wiki/IP_over_Avian_Carriers

    15. Constructed language

    16. Rod McKuen  :

      https://en.wikipedia.org/wiki/Rod_McKuen