Gwern.net newsletter (Substack subscription page)
August 2020 News
‘newsletter’ directory
Changelog
Gwern Branwen Creating Essays on Gwern.net
Instant.page: Make your site’s pages instant in 1 minute and improve your conversion rate noticeably.
asterism-triplewhitestar.svg
Lorem Ipsum
ReBeL: Combining Deep Reinforcement Learning and Search for Imperfect-Information Games
Assessing Game Balance with AlphaZero: Exploring Alternative Rule Sets in Chess
A digital biomarker of diabetes from smartphone-based vascular signals
Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning
Tasks, stability, architecture, and compute: Training more effective learned optimizers, and using them to train themselves
Gradient Descent: The Ultimate Optimizer
Reviewer #2 Doubted That Our Hyper-Hyperparameter Optimizer (Https://arxiv.org/abs/1909.13371) Would Work for Larger Examples. Of Course It Does, but Thanks for Asking. (Erik Meijer)
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers
Text-To-Image Generation: Text-To-Image Generation Is the Task of Generating an Image Conditioned on the Input Text. Try It for Yourself: 1. Choose a Caption
StyleGAN network blending
Toonify: Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domains
Optimal Peanut Butter and Banana Sandwiches
DeepSpeed: Extreme-scale model training for everyone
L2L: Training Large Neural Networks with Constant Memory using a New Execution Algorithm
DeepSpeed Sparse Attention
Generative Language Modeling for Automated Theorem Proving
The Examples Are Indeed Extremely Simple on Purpose (Otherwise It’s Hard to Communicate Efficiently What’s Happening to Non-Metamath Experts). That Being Said, We’re Still Pretty Far Away from IMOs; but This Is Definitely a Goal for Us, and One We’re Actively Working Towards!
MMLU: Measuring Massive Multitask Language Understanding
2020-hendrycks-figure1b-gpt3-qascaling.png
DynamicEmbedding: Extending TensorFlow for Colossal-Scale Applications
Why Tool AIs Want to Be Agent AIs
A Time Leap Challenge for SAT Solving
Computer Optimization: Your Computer Is Faster Than You Think
Algorithmic Progress in Six Domains
Efficient Transformers: A Survey
‘self-attention’ directory
A general dimension of genetic sharing across diverse cognitive traits inferred from molecular data
Mapping genomic loci prioritises genes and implicates synaptic biology in schizophrenia
Extended Data Figure 2: GWAS Progress over Time. The Relationship of GWAS Associations to Sample-Size Is Shown in This Plot With Selected SCZ GWAS Meta-Analyses of the past 11 Years. The X-Axis Shows Number of Cases. The Y-Axis Shows the Number of Independent Loci Discovered With at Least One Genome-Wide Statistically-Significant Index SNP in the Discovery Meta-Analysis (Eg. without Replication Data)…The Slope of ~4 Newly Discovered Loci per 1,000 Cases 2013–2019 Increased to a Slope of ~6 With the Latest Sample-Size Increase.
Exome sequencing identifies rare coding variants in 10 genes which confer substantial risk for schizophrenia
Figure 6: The Contributions of Ultra-Rare PTVs [Protein-Truncating Variants] to Schizophrenia Risk. A: Genetic Architecture of Schizophrenia. Statistically-Significant Genetic Associations for Schizophrenia from the Most Recent GWAS, CNV, and Sequencing Studies Are Displayed. The In-Sample Odds Ratio Is Plotted against the Minor Allele Frequency in the General Population. The Color of Each Dot Corresponds to the Source of the Association, and the Size of the Dot to the Odds Ratio. The Shaded Area Represented the LOESS-Smoothed Lines of the Upper and Lower Bounds of the Point Estimates…Because Schizophrenia As a Trait Is under Strong Selection38–40, We Expect That URVs of Large Effect to Be Frequently de Novo or of Very Recent Origin and Contribute to Risk in Only a Fraction of Diagnosed Patients.
Genome-wide association study of over 40,000 bipolar disorder cases provides novel biological insights
Genetic Fortune: Winning or Losing Education, Income, and Health
GWAS of Over 427,000 Individuals Establishes GABAergic and Synaptic Molecular Pathways as Key for Cognitive Executive Functions
Shared heritability of face and brain shape distinct from cognitive traits
Rapid Evolution of Plastic-degrading Enzymes Prevalent in the Global Ocean
The Przewalski’s Horse Project
Human Embryo Gene Editing Gets a Road Map—Not a Green Light: After the 2018 ‘Crispr baby’ scandal, a global commission assessed the technology and set strict criteria for moving it toward clinical trials
Heritable Human Genome Editing
CRISPR-engineered human brown-like adipocytes prevent diet-induced obesity and ameliorate metabolic syndrome in mice
CRISPR-enhanced human adipocyte ‘browning’ as cell therapy for metabolic disease
Blueberry Earth
America in Decay: The Sources of Political Dysfunction
Constitutional Hardball
The Empty Chamber: Just how broken is the Senate?
‘Dwarf Pride’ Was Hard Won. Will a Growth Drug Undermine It?: An experimental medication that increases height in children with the most common form of dwarfism has raised hope that it can help them lead easier lives. But some say the condition is not a problem in need of a cure.
FDA Approves First Drug for Genetic Cause of Dwarfism
Once-daily, subcutaneous vosoritide therapy in children with achondroplasia: a randomized, double-blind, phase 3, placebo-controlled, multicenter trial
An expressed fgf4 retrogene is associated with breed-defining chondrodysplasia in domestic dogs.
Laws of Xmas [Have you ever wondered what Xmas would be like if it were a Jewish Holiday?…]
Self-Supervised Natural Image Reconstruction and Rich Semantic Classification from Brain Activity
WBE and DRL: a Middle Way of imitation learning
Catching Cowpox: The Early Spread of Smallpox Vaccination, 1798–1810
Creativity and Intelligence: An Investigation of the Threshold Hypothesis
Water on Mars: discovery of three buried lakes intrigues scientists: Researchers have detected a group of lakes hidden under the red planet’s icy surface.
M51-ULS-1b: The First Candidate for a Planet in an External Galaxy
Unraveling the JPEG: JPEG images are everywhere in our digital lives, but behind the veil of familiarity lie algorithms that remove details that are imperceptible to the human eye. This produces the highest visual quality with the smallest file size—but what does that look like? Let’s see what our eyes can’t see!
The Recursive Universe
OTCA metapixel
The First Roman Fonts
Salary Negotiation: Make More Money, Be More Valued
A Deep Dive into K-pop
Wikipedia Matters
![Figure 6: The Contributions of Ultra-Rare PTVs [Protein-Truncating Variants] to Schizophrenia Risk. A: Genetic Architecture of Schizophrenia. Statistically-Significant Genetic Associations for Schizophrenia from the Most Recent GWAS, CNV, and Sequencing Studies Are Displayed. The In-Sample Odds Ratio Is Plotted against the Minor Allele Frequency in the General Population. The Color of Each Dot Corresponds to the Source of the Association, and the Size of the Dot to the Odds Ratio. The Shaded Area Represented the LOESS-Smoothed Lines of the Upper and Lower Bounds of the Point Estimates…Because Schizophrenia As a Trait Is under Strong Selection38–40, We Expect That URVs of Large Effect to Be Frequently de Novo or of Very Recent Origin and Contribute to Risk in Only a Fraction of Diagnosed Patients.](/doc/genetics/heritable/rare/2020-singh-figure6a-thecontributionsofultrarareptvstoschizophreniarisk.jpg){kind=link}