June 2022 News
June 2022 Gwern.net newsletter with links on TODO
June 2022’s Gwern.net newsletter is now out; previous, May 2022 (archives). This is a collation of links and summary of major changes, overlapping with my Changelog; brought to you by my donors on Patreon.
Writings
-
Gwern.net: ‘partial’ annotation popups (enhancement of live-links)
Links
AI
-
“Director: Deep Hierarchical Planning from Pixels”, et al 2022 (hierarchical RL over world models); “Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos”, et al 2022; “DreamerV3: Mastering Diverse Domains through World Models”, et al 2023 (can collect Minecraft diamonds from scratch in 50 episodes/29m steps using 17 GPU-days; scales w/model-size to 0.2b-parameters)
-
“DeepNash: Mastering the Game of Stratego with Model-Free Multiagent Reinforcement Learning”, et al 2022
-
“A Neural Corpus Indexer for Document Retrieval”, et al 2022
-
5th anniversary of Transformers
-
“RST: reStructured Pre-training”, 2022 (rewriting 55 datasets into many formatted prompts for finetuning T5; good exam Q&A)
-
“
tflite_c64
: Run inferences using TensorFlow Lite for Microcontrollers on a Commodore 64”, Nick Bild (compiling tiny NNs to a sequence of BASIC instructions for a C64); “On-Device Training Under 256KB Memory”, et al 2022
Genetics
Everything Is Heritable:
Recent Evolution:
Engineering:
Statistics/Meta-Science
-
“False Discovery in A/B Testing”, Berman & Van den 2021 (“high fraction of true null effects, about 70%” in e-commerce tests)
-
“Residual Confounding in Health Plan Performance Assessments: Evidence From Randomization in Medicaid”, et al 2022 (how often does correlation=causality? ~100% overestimate from all correlation estimates in Medicaid natural experiment)
-
“She Spent a Decade Writing Fake Russian History. Zh Wikipedia Just Noticed.”/Vice (WP; she wrote millions of words, 206 new articles, w/100s edited)
Politics/Religion
Psychology/Biology
-
“A Whole Population Network and Its Application for the Social Sciences”, van der et al 2022 (an incredible new population registry: “A multilevel network of the entire 2018 Dutch population with links to identify relatives, household members, neighbours, work colleagues, and classmates”)
Technology
-
“Progress in Mathematical Programming Solvers 2001–192020”, et al 2022 (ratio of hardware:software progress in linear/integer programming: 20:9 & 20:50)
-
“Searching for Cyclic TV Reference Paradoxes”, Jamie Pinheiro
Economics
Philosophy
Fiction
Miscellaneous
Books
Nonfiction:
Fiction:
Film/TV
Live-action:
Animated:
Music
MLP:
Doujin:
Misc: