AI

• “Director: Deep Hierarchical Planning from Pixels”⁠, Hafneret al2022 (hierarchical RL over world models); “Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos”⁠, Bakeret al2022; “DreamerV3: Mastering Diverse Domains through World Models”⁠, Hafneret al2023 (can collect Minecraft diamonds from scratch in 50 episodes/29m steps using 17 GPU-days; scales w/model-size to 0.2b-parameters)

• “DeepNash: Mastering the Game of Stratego with Model-Free Multiagent Reinforcement Learning”⁠, Perolatet al2022

• “A Neural Corpus Indexer for Document Retrieval”⁠, Wanget al2022

Matters Of⁠ ⁠Scale⁠:

• 5^th anniversary of Transformers⁠

• “RST: reStructured Pre-training”⁠, Yuan & Liu2022 (rewriting 55 datasets into many formatted prompts for finetuning T5⁠; good exam Q&A)

• “tflite_c64: Run inferences using TensorFlow Lite for Microcontrollers on a Commodore 64”⁠, Nick Bild (compiling tiny NNs to a sequence of BASIC⁠ instructions for a C64⁠); “On-Device Training Under 256KB Memory”⁠, Linet al2022

Genetics

Everything Is Heritable:

• “The impact of rare protein coding genetic variation on adult cognitive function”⁠, Chenet al2022

Recent Evolution:

Engineering:

Statistics/Meta-Science

• “False Discovery in A/B Testing”⁠, Berman & Van den Bulte2021 (“high fraction of true null effects, about 70%” in e-commerce tests)

• “Residual Confounding in Health Plan Performance Assessments: Evidence From Randomization in Medicaid”⁠, Wallaceet al2022 (how often does correlation=causality? ~100% overestimate from all correlation estimates in Medicaid natural experiment⁠)

• “She Spent a Decade Writing Fake Russian History. Zh Wikipedia Just Noticed.”/Vice⁠ (WP⁠; she wrote millions of words, 206 new articles, w/100s edited)

Politics/Religion

Psychology/Biology

• “A Whole Population Network and Its Application for the Social Sciences”⁠, van der Laanet al2022 (an incredible new population registry⁠: “A multilevel network of the entire 2018 Dutch population with links to identify relatives, household members, neighbours, work colleagues, and classmates”)

Technology

• “Progress in Mathematical Programming Solvers 2001^–₁₉2020”⁠, Kochet al2022 (ratio of hardware:software progress in linear/integer programming: 20:9 & 20:50)

• “Searching for Cyclic TV Reference Paradoxes”, Jamie Pinheiro

Economics

Philosophy

Fiction

Miscellaneous