AI

• “Director: Deep Hierarchical Planning from Pixels”, Hafner et al 2022 (hierarchical RL over world models); “Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos”, Baker et al 2022; “DreamerV3: Mastering Diverse Domains through World Models”, Hafner et al 2023 (can collect Minecraft diamonds from scratch in 50 episodes/29m steps using 17 GPU-days; scales w/model-size to 0.2b-parameters)

• “DeepNash: Mastering the Game of Stratego with Model-Free Multiagent Reinforcement Learning”, Perolat et al 2022

• “A Neural Corpus Indexer for Document Retrieval”, Wang et al 2022

Matters Of Scale:

• 5^th anniversary of Transformers

• “RST: reStructured Pre-training”, Yuan & Liu 2022 (rewriting 55 datasets into many formatted prompts for finetuning T5; good exam Q&A)

• “tflite_c64: Run inferences using TensorFlow Lite for Microcontrollers on a Commodore 64”, Nick Bild (compiling tiny NNs to a sequence of BASIC instructions for a C64); “On-Device Training Under 256KB Memory”, Lin et al 2022

Genetics

Everything Is Heritable:

• “The impact of rare protein coding genetic variation on adult cognitive function”, Chen et al 2022

Recent Evolution:

Engineering:

Statistics/Meta-Science

• “False Discovery in A/B Testing”, Berman & Van den Bulte 2021 (“high fraction of true null effects, about 70%” in e-commerce tests)

• “Residual Confounding in Health Plan Performance Assessments: Evidence From Randomization in Medicaid”, Wallace et al 2022 (how often does correlation=causality? ~100% overestimate from all correlation estimates in Medicaid natural experiment)

• “She Spent a Decade Writing Fake Russian History. Zh Wikipedia Just Noticed.”/Vice (WP; she wrote millions of words, 206 new articles, w/100s edited)

Politics/Religion

Psychology/Biology

• “A Whole Population Network and Its Application for the Social Sciences”, van der Laan et al 2022 (an incredible new population registry: “A multilevel network of the entire 2018 Dutch population with links to identify relatives, household members, neighbours, work colleagues, and classmates”)

Technology

• “Progress in Mathematical Programming Solvers 2001^–₁₉2020”, Koch et al 2022 (ratio of hardware:software progress in linear/integer programming: 20:9 & 20:50)

• “Searching for Cyclic TV Reference Paradoxes”, Jamie Pinheiro

Economics

Philosophy

Fiction

Miscellaneous