August 2022 News
August 2022 Gwern.net newsletter with links on TODO
August 2022’s Gwern.net newsletter is now out; previous, July 2022 (archives). This is a collation of links and summary of major changes, overlapping with my Changelog; brought to you by my donors on Patreon.
Writings
Gwern.net:
new dynamic lazy transclusions:
transclude.jssidenotes/margin notes: margin notes now appear exclusively in the left column and sidenotes in the right column, to keep visual simplicity and emphasis the left-to-right summary → detail hierarchical reading
Links
AI
“Our approach to alignment research”, Leike et al 2022 (short overview: InstructGPT, debate, & GPT for alignment research); “The alignment problem from a deep learning perspective”, Ngo 2022
“What do surveyed ML researchers think about AI in July–August 2022?”, AI Impacts (opinion remains highly inconsistent & inchoate, but timelines are faster & deadlier than 2016)
“MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks”, Lu et al 2022 (MIDI/piano roll)
“U.S. officials order Nvidia to halt sales of top AI chips to China”
“Centaur: a foundation model of human cognition”, Binz et al 2024; “Generative Agent Simulations of 1,000 People”, Park et al 2024; “Social Simulacra: Creating Populated Prototypes for Social Computing Systems”, Park et al 2022 (prompting for GPT-3 to generate ‘communities’ of personas); “Using Large Language Models to Simulate Multiple Humans”, Aher et al 2022 (eg. age groups); Typical.me; “My coworkers are GPT-4 bots, and we all hang out on Slack”; Chirper.ai; “Beyond Memorization: Violating Privacy Via Inference with Large Language Models”, Staab et al 2023/“Language Models Model Us”/“Designing a Dashboard for Transparency and Control of Conversational AI”, Chen et al 2024; “LLMs can Strategically Deceive their Users when Put Under Pressure”, Scheurer et al 2023; “Can a computer outfake a human [personality]?”, Phillips & Robie 2023; “Using Sequences of Life-events to Predict Human Lives”, Savcisens et al 2023; “Automated Social Science: Language Models as Scientist and Subjects”, Manning et al 2024; “Language models accurately infer correlations between psychological items and scales from text alone”, Hommel & Arslan 2024
“Stable Diffusion Public Release”, Stability.Ai (SD checkpoints now fully publicly released; work continues on even higher-quality successor; ponies, anime, Japanese—“but is it Art?”)
“Semantic scene descriptions as an objective of human vision”, Doerig et al 2022 (using Jean et al 2021); “Semantic reconstruction of continuous language from non-invasive brain recordings”, Tang et al 2022; “Decoding speech from non-invasive brain recordings”, Défossez et al 2022; “Brain2GAN: Reconstructing perceived faces from the primate brain via StyleGAN3”, Anonymous et al 2022
“A Future History of Biomedical Progress”, Adam Green (applying DL scaling law paradigm to bio)
“AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model”, Soltan et al 2022; “SAP: Bidirectional Language Models Are Also Few-shot Learners”, Patel et al 2022 (T5 finally does meta-learning)
“Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning”, Wiles et al 2022 (towards closing loops)
Genetics
Everything Is Heritable:
“23andMe added approximately 300,000…bringing its total number of genotyped customers to 13.1 million”; “Hospital and Drug-maker Move to Build Vast Database of New Yorkers’ DNA”
Recent Evolution:
Engineering:
-
“Post-Gastrulation Synthetic Embryos Generated Ex Utero from Naïve Mouse Embryonic Stem Cells”, Tarazi et al 2022
“Embryo model completes gastrulation to neurulation and organogenesis”, Amadei et al 2022
“Viable offspring derived from single unfertilized mammalian oocytes”, Wei et al 2022
“Mouse-embryo model derived exclusively from embryonic stem cells undergo neurulation and heart development”, Lau et al 2022; “Stem cell-derived mouse embryos develop within an extra-embryonic yolk sac to form anterior brain regions and a beating heart”, Zernicka-Goetz et al 2022
“Ex vivo reconstitution of fetal oocyte development in humans and cynomolgus monkeys”, Mizuta et al 2022
Statistics/Meta-Science
“Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?”, Brodeur et al 2022 (pre-registered studies need to specify the exact analysis for it to work)
“Reproducibility in the Social Sciences”, Moody et al 2022; “It pays to be ignorant: A simple political economy of rigorous program evaluation”, Pritchett 2002
Politics/Religion
Psychology/Biology
“Cognitive Training: A Field in Search of a Phenomenon”, Gobet & Sala 2022
Technology
“When Every Ketchup But One Went Extinct: The main casualty of the catsup war was flavor” (the war over benzoates & ketchup extinction as byproduct)
Economics
Philosophy
Fiction
Miscellaneous
Books
Nonfiction:
Fiction:
Film/TV
Live-action:
Animated:
Music
MLP:
Doujin:
Misc: