Gwern.net newsletter (Substack subscription page)
May 2020 News
‘newsletter’ directory
Changelog
Gwern Branwen Creating Essays on Gwern.net
GPT-3 Creative Fiction
Anime Crop Datasets: Faces, Figures, & Hands § Hands
Technology Holy Wars are Coordination Problems
Efficient polygenic risk scores for biobank scale data by exploiting phenotypes from inferred relatives
One Hundred Years of Statistical Developments in Animal Breeding
Germline mutation rates in young adults predict longevity and reproductive lifespan
Whole-genome sequencing of rare disease patients in a national healthcare system
Genomic analyses implicate noncoding de novo variants in congenital heart disease
Genetic ancestry analysis on >93,000 individuals undergoing expanded carrier screening reveals limitations of ethnicity-based medical guidelines
An integrated polygenic and clinical risk tool enhances coronary artery disease prediction
Evidence of Polygenic Adaptation in Sardinia at Height-Associated Loci Ascertained from the Biobank Japan
Three people with inherited diseases successfully treated with CRISPR
Preimplantation Genetic Testing for Polygenic Disease Relative Risk Reduction: Evaluation of Genomic Index Performance in 11,883 Adult Sibling Pairs
Screening Human Embryos for Polygenic Traits Has Limited Utility
Utility and First Clinical Application of Screening Embryos for Polygenic Disease Risk Reduction
Embryo Selection For Intelligence
A Year In, 1st Patient To Get Gene Editing For Sickle Cell Disease Is Thriving
Image Augmentations for GAN Training
On Data Augmentation for GAN Training
StyleGAN2-ADA: Training Generative Adversarial Networks with Limited Data
Differentiable Augmentation for Data-Efficient GAN Training
https://github.com/tensorfork/tensorfork/issues/35
Improved Consistency Regularization for GANs
Learning to Play No-Press Diplomacy with Best Response Policy Iteration
Exploration Strategies in Deep Reinforcement Learning
OpenAI API
OpenAI API Beta homepage
Code Completion Demo
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
We Ran MoE (2048E,60L) With Bfloat16 Activations With Total of 1 Trillion Model Weights. Although Trainable With Manual Diagnostics, With Deep 1 Trillion Model We Encountered Several Trainability Issues With Numerical Stability. Will Follow Up.
Image GPT (iGPT): We find that, just as a large transformer model trained on language can generate coherent text, the same exact model trained on pixel sequences can generate coherent image completions and samples
iGPT: Generative Pretraining from Pixels
Generative Modeling with Sparse Transformers: We’ve developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence—whether text, images, or sound. It uses an algorithmic improvement of the attention mechanism to extract patterns from sequences 30× longer than possible previously
Startup Tenstorrent shows AI is changing computing and vice versa: Tenstorrent is one of the rush of AI chip makers founded in 2016 and finally showing product. The new wave of chips represent a substantial departure from how traditional computer chips work, but also point to ways that neural network design may change in the years to come
Form 990 [OpenAI 2018]
Deepmind Technologies Limited: Report and Financial Statements Year Ended 31 December 2018 [Full Accounts]
Form 990 [OpenAI 2016]
Form 990 [OpenAI 2017]
2014-deepmind-fullaccounts.pdf
Audited Financial Statements DeepMind Technologies Limited For the Year Ended 31 December 2015 [Full Accounts]
Audited Financial Statements DeepMind Technologies Limited For the Year Ended 31 December 2016 [Full Accounts]
Deepmind Technologies Limited: Report and Financial Statements Year Ended 31 December 2017 [Full Accounts]
Deepmind Technologies Limited: Report and Financial Statements Year Ended 31 December 2019 [Full Accounts]
How Big Should My Language Model Be?
Fashion Cycles
Accelerating dynamics of collective attention
Up and down with ecology—the ‘issue-attention cycle’
The universal decay of collective memory and attention
Radical Chic: That Party at Lenny’s
https://teageegeepea.tripod.com/maumau.html
Agenda Seeding: How 1960s Black Protests Moved Elites, Public Opinion and Voting
The Cost of Torture: Evidence from the Spanish Inquisition
Breast-Feeding of Animals by Women: Its Socio-Cultural Context and Geographic Occurrence
Did Breast-Feeding Play A Role In the Evolution of Pets? Like the dolphin who adopted a baby whale, humans have often breast-fed pets
Animal Ethics and Evolutionary Psychology—10 ideas
Incest Laws and Absent Taboos in Roman Egypt
The Curse of Konzo: In 1981, an international group of doctors identified the devastating disease behind a perplexing outbreak of paralysis in northern Mozambique
Generalizing From One Example [typical mind fallacy]
Why Humans Totally Freak Out When They Get Lost: People really do circle past the same tree over and over again—it doesn’t just happen in movies
15 Years of Research on Redirected Walking in Immersive Virtual Environments
Increased weight loading reduces body weight and body fat in obese subjects—A proof of concept randomized clinical trial
Body weight homeostat that regulates fat mass independently of leptin in rats and mice
The Gravitostat Regulates Fat Mass in Obese Male Mice While Leptin Regulates Fat Mass in Lean Male Mice
Where does the gravitostat fit in?
Interactions Between the Gravitostat and the Fibroblast Growth Factor System for the Regulation of Body Weight
Human postprandial responses to food and potential for precision nutrition
Fast food outlets, physical activity facilities, and obesity among adults: a nationwide longitudinal study from Sweden
Association Between Lottery Prize Size and Self-reported Health Habits in Swedish Lottery Players
The Iron Law Of Evaluation And Other Metallic Rules
Health Recommendations and Selection in Health Behaviors
‘Johan Bjorksten (aging)’ directory
modus#bjorksten
[Transclude the forward-link's
context]
On the Potential of Silicon as a Building Block for Life
A Group is Its Own Worst Enemy
The Concept of a Meta-Font
The Monotype 4-Line System for Setting Mathematics
From boiling lead and black art: An essay on the history of mathematical typography
Real-world dynamic programming: seam carving
Seam carving for content-aware image resizing
The Incredible Story of the US Army’s Earth-Shaking, Off-Road Land Trains: Oh, your pickup has a lift? That’s cute
When SimCity got serious: the story of Maxis Business Simulations and SimRefinery
‘tech economics’ directory
Schrödinger’s Zombie: Adam Brown at the 6th FQXi Meeting
"Interaction-Free" Imaging
Quantum Effects in Algorithms
Classical Computation can be Counterfactual 1996-09-02 V1.1 (or Can Schrodinger’s Cat Collapse the Wavefunction?)
The Printing of Mathematics: Aids for Authors and Editors and Rules for Compositors and Readers at the University Press, Oxford
Pumped Up Kicks (Bardcore)