-
Gwern.net newsletter (Substack subscription page)
-
August 2020 News
-
‘newsletter’ directory
-
Changelog
-
Gwern Branwen Creating Essays on Gwern.net
-
Instant.page: Make your site’s pages instant in 1 minute and improve your conversion rate noticeably.
-
asterism-triplewhitestar.svg
-
Lorem Ipsum
-
ReBeL: Combining Deep Reinforcement Learning and Search for Imperfect-Information Games
-
Assessing Game Balance with AlphaZero: Exploring Alternative Rule Sets in Chess
-
A digital biomarker of diabetes from smartphone-based vascular signals
-
Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning
-
Tasks, stability, architecture, and compute: Training more effective learned optimizers, and using them to train themselves
-
Gradient Descent: The Ultimate Optimizer
-
Reviewer #2 Doubted That Our Hyper-Hyperparameter Optimizer (Https://arxiv.org/abs/1909.13371) Would Work for Larger Examples. Of Course It Does, but Thanks for Asking. (Erik Meijer)
-
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers
-
Text-To-Image Generation: Text-To-Image Generation Is the Task of Generating an Image Conditioned on the Input Text. Try It for Yourself: 1. Choose a Caption
-
StyleGAN network blending
-
Toonify: Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domains
-
Optimal Peanut Butter and Banana Sandwiches
-
DeepSpeed: Extreme-scale model training for everyone
-
L2L: Training Large Neural Networks with Constant Memory using a New Execution Algorithm
-
DeepSpeed Sparse Attention
-
Generative Language Modeling for Automated Theorem Proving
-
The Examples Are Indeed Extremely Simple on Purpose (Otherwise It’s Hard to Communicate Efficiently What’s Happening to Non-Metamath Experts). That Being Said, We’re Still Pretty Far Away from IMOs; but This Is Definitely a Goal for Us, and One We’re Actively Working Towards!
-
MMLU: Measuring Massive Multitask Language Understanding
-
2020-hendrycks-figure1b-gpt3-qascaling.png
-
DynamicEmbedding: Extending TensorFlow for Colossal-Scale Applications
-
Why Tool AIs Want to Be Agent AIs
-
A Time Leap Challenge for SAT Solving
-
Computer Optimization: Your Computer Is Faster Than You Think
-
Algorithmic Progress in Six Domains
-
Efficient Transformers: A Survey
-
Efficient Attention: Breaking The Quadratic Transformer Bottleneck
-
A general dimension of genetic sharing across diverse cognitive traits inferred from molecular data
-
Mapping genomic loci prioritises genes and implicates synaptic biology in schizophrenia
-
Extended Data Figure 2: GWAS Progress over Time. The Relationship of GWAS Associations to Sample-Size Is Shown in This Plot With Selected SCZ GWAS Meta-Analyses of the past 11 Years. The X-Axis Shows Number of Cases. The Y-Axis Shows the Number of Independent Loci Discovered With at Least One Genome-Wide Statistically-Significant Index SNP in the Discovery Meta-Analysis (Eg. without Replication Data)…The Slope of ~4 Newly Discovered Loci per 1,000 Cases 2013–2019 Increased to a Slope of ~6 With the Latest Sample-Size Increase.
-
Exome sequencing identifies rare coding variants in 10 genes which confer substantial risk for schizophrenia
-
Figure 6: The Contributions of Ultra-Rare PTVs [Protein-Truncating Variants] to Schizophrenia Risk. A: Genetic Architecture of Schizophrenia. Statistically-Significant Genetic Associations for Schizophrenia from the Most Recent GWAS, CNV, and Sequencing Studies Are Displayed. The In-Sample Odds Ratio Is Plotted against the Minor Allele Frequency in the General Population. The Color of Each Dot Corresponds to the Source of the Association, and the Size of the Dot to the Odds Ratio. The Shaded Area Represented the LOESS-Smoothed Lines of the Upper and Lower Bounds of the Point Estimates…Because Schizophrenia As a Trait Is under Strong Selection38–40, We Expect That URVs of Large Effect to Be Frequently de Novo or of Very Recent Origin and Contribute to Risk in Only a Fraction of Diagnosed Patients.
-
Genome-wide association study of over 40,000 bipolar disorder cases provides novel biological insights
-
Genetic Fortune: Winning or Losing Education, Income, and Health
-
GWAS of Over 427,000 Individuals Establishes GABAergic and Synaptic Molecular Pathways as Key for Cognitive Executive Functions
-
Shared heritability of face and brain shape distinct from cognitive traits
-
Rapid Evolution of Plastic-degrading Enzymes Prevalent in the Global Ocean
-
The Przewalski’s Horse Project
-
Human Embryo Gene Editing Gets a Road Map—Not a Green Light: After the 2018 ‘Crispr baby’ scandal, a global commission assessed the technology and set strict criteria for moving it toward clinical trials
-
Heritable Human Genome Editing
-
CRISPR-engineered human brown-like adipocytes prevent diet-induced obesity and ameliorate metabolic syndrome in mice
-
CRISPR-enhanced human adipocyte ‘browning’ as cell therapy for metabolic disease
-
Blueberry Earth
-
America in Decay: The Sources of Political Dysfunction
-
Constitutional Hardball
-
The Empty Chamber: Just how broken is the Senate?
-
‘Dwarf Pride’ Was Hard Won. Will a Growth Drug Undermine It?: An experimental medication that increases height in children with the most common form of dwarfism has raised hope that it can help them lead easier lives. But some say the condition is not a problem in need of a cure.
-
FDA Approves First Drug for Genetic Cause of Dwarfism
-
Once-daily, subcutaneous vosoritide therapy in children with achondroplasia: a randomized, double-blind, phase 3, placebo-controlled, multicenter trial
-
An expressed fgf4 retrogene is associated with breed-defining chondrodysplasia in domestic dogs.
-
Laws of Xmas [Have you ever wondered what Xmas would be like if it were a Jewish Holiday?…]
-
Self-Supervised Natural Image Reconstruction and Rich Semantic Classification from Brain Activity
-
WBE & DRL: a Middle Way of imitation learning on brains
-
Catching Cowpox: The Early Spread of Smallpox Vaccination, 1798–1810
-
Creativity and Intelligence: An Investigation of the Threshold Hypothesis
-
Water on Mars: discovery of three buried lakes intrigues scientists: Researchers have detected a group of lakes hidden under the red planet’s icy surface.
-
M51-ULS-1b: The First Candidate for a Planet in an External Galaxy
-
Unraveling the JPEG: JPEG images are everywhere in our digital lives, but behind the veil of familiarity lie algorithms that remove details that are imperceptible to the human eye. This produces the highest visual quality with the smallest file size—but what does that look like? Let’s see what our eyes can’t see!
-
The Recursive Universe
-
OTCA metapixel
-
The First Roman Fonts
-
Salary Negotiation: Make More Money, Be More Valued
-
A Deep Dive into K-pop
-
Wikipedia Matters
-