August 2022 News
August 2022 Gwern.net newsletter with links on TODO
August 2022’s Gwern.net newsletter is now out; previous, July 2022 (archives). This is a collation of links and summary of major changes, overlapping with my Changelog; brought to you by my donors on Patreon.
Writings
Gwern.net:
new dynamic lazy transclusions:
transclude.js
sidenotes/
margin notes: margin notes now appear exclusively in the left column and sidenotes in the right column, to keep visual simplicity and emphasis the left-to-right summary → detail hierarchical reading
Links
AI
“Our approach to alignment research”, et al2022 (short overview: InstructGPT, debate, & GPT for alignment research); “The alignment problem from a deep learning perspective”, 2022
“What do surveyed ML researchers think about AI in July–August 2022?”, AI Impacts (opinion remains highly inconsistent & inchoate, but timelines are faster & deadlier than 2016)
“MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks”, et al2022 (MIDI/
piano roll)
“U.S. officials order Nvidia to halt sales of top AI chips to China”
“Centaur: a foundation model of human cognition”, et al2024; “Generative Agent Simulations of 1,000 People”, et al2024; “Social Simulacra: Creating Populated Prototypes for Social Computing Systems”, et al2022 (prompting for GPT-3 to generate ‘communities’ of personas); “Using Large Language Models to Simulate Multiple Humans”, et al2022 (eg. age groups); Typical.me; “My coworkers are GPT-4 bots, and we all hang out on Slack”; Chirper.ai; “Beyond Memorization: Violating Privacy Via Inference with Large Language Models”, et al2023/
“Language Models Model Us”/ “Designing a Dashboard for Transparency and Control of Conversational AI”, et al2024; “LLMs can Strategically Deceive their Users when Put Under Pressure”, et al2023; “Can a computer outfake a human [personality]?”, 2023; “Using Sequences of Life-events to Predict Human Lives”, et al2023; “Automated Social Science: Language Models as Scientist and Subjects”, et al2024; “Language models accurately infer correlations between psychological items and scales from text alone”, 2024 “Stable Diffusion Public Release”, Stability.Ai (SD checkpoints now fully publicly released; work continues on even higher-quality successor; ponies, anime, Japanese—“but is it Art?”)
“Semantic scene descriptions as an objective of human vision”, et al2022 (using et al2021); “Semantic reconstruction of continuous language from non-invasive brain recordings”, et al2022; “Decoding speech from non-invasive brain recordings”, et al2022; “Brain2GAN: Reconstructing perceived faces from the primate brain via StyleGAN3”, et al2022
“A Future History of Biomedical Progress”, Adam Green (applying DL scaling law paradigm to bio)
“AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model”, et al2022; “SAP: Bidirectional Language Models Are Also Few-shot Learners”, et al2022 (T5 finally does meta-learning)
“Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning”, et al2022 (towards closing loops)
Genetics
Everything Is Heritable:
“23andMe added approximately 300,000…bringing its total number of genotyped customers to 13.1 million”; “Hospital and Drug-maker Move to Build Vast Database of New Yorkers’ DNA”
Recent Evolution:
Engineering:
“Post-Gastrulation Synthetic Embryos Generated Ex Utero from Naïve Mouse Embryonic Stem Cells”, et al2022
“Embryo model completes gastrulation to neurulation and organogenesis”, et al2022
“Viable offspring derived from single unfertilized mammalian oocytes”, et al2022
“Mouse-embryo model derived exclusively from embryonic stem cells undergo neurulation and heart development”, et al2022; “Stem cell-derived mouse embryos develop within an extra-embryonic yolk sac to form anterior brain regions and a beating heart”, Zernicka-et al2022
“Ex vivo reconstitution of fetal oocyte development in humans and cynomolgus monkeys”, et al2022
Statistics/Meta-Science
“Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?”, et al2022 (pre-registered studies need to specify the exact analysis for it to work)
“Reproducibility in the Social Sciences”, et al2022; “It pays to be ignorant: A simple political economy of rigorous program evaluation”, 2002
Politics/Religion
Psychology/Biology
Technology
“When Every Ketchup But One Went Extinct: The main casualty of the catsup war was flavor” (the war over benzoates & ketchup extinction as byproduct)
Economics
Philosophy
Fiction
Miscellaneous
Books
Nonfiction:
Fiction:
Film/TV
Live-action:
Animated:
Music
MLP:
Doujin:
Misc: