August 2022 Gwern.net newsletter with links on TODO
August 2022’s Gwern.net newsletter is now out; previous, July 2022 (archives). This is a collation of links and summary of major changes, overlapping with my Changelog; brought to you by my donors on Patreon.
Writings
-
Gwern.net:
-
new dynamic lazy transclusions:
transclude.js
-
sidenotes/margin notes: margin notes now appear exclusively in the left column and sidenotes in the right column, to keep visual simplicity and emphasis the left-to-right summary → detail hierarchical reading
-
Links
AI
-
“Our approach to alignment research”, et al 2022 (short overview: InstructGPT, debate, & GPT for alignment research); “The alignment problem from a deep learning perspective”, 2022
-
“What do surveyed ML researchers think about AI in July–August 2022?”, AI Impacts (opinion remains highly inconsistent & inchoate, but timelines are faster & deadlier than 2016)
-
“MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks”, et al 2022 ( MIDI/piano roll)
-
“U.S. officials order Nvidia to halt sales of top AI chips to China”
-
“Centaur: a foundation model of human cognition”, et al 2024; “Social Simulacra: Creating Populated Prototypes for Social Computing Systems”, et al 2022 (prompting for GPT-3 to generate ‘communities’ of personas); “Using Large Language Models to Simulate Multiple Humans”, et al 2022 (eg. age groups); Typical.me; “My coworkers are GPT-4 bots, and we all hang out on Slack”; Chirper.ai; “Beyond Memorization: Violating Privacy Via Inference with Large Language Models”, et al 2023/ “Language Models Model Us”/“Designing a Dashboard for Transparency and Control of Conversational AI”, et al 2024; “LLMs can Strategically Deceive their Users when Put Under Pressure”, et al 2023; “Can a computer outfake a human [personality]?”, 2023; “Using Sequences of Life-events to Predict Human Lives”, et al 2023; “Automated Social Science: Language Models as Scientist and Subjects”, et al 2024; “Language models accurately infer correlations between psychological items and scales from text alone”, 2024
-
“Stable Diffusion Public Release”, Stability.Ai (SD checkpoints now fully publicly released; work continues on even higher-quality successor; ponies, anime, Japanese—“but is it Art?”)
-
“Semantic scene descriptions as an objective of human vision”, et al 2022 (using et al 2021 ); “Semantic reconstruction of continuous language from non-invasive brain recordings”, et al 2022; “Decoding speech from non-invasive brain recordings”, et al 2022; “Brain2GAN: Reconstructing perceived faces from the primate brain via StyleGAN3”, et al 2022
-
“A Future History of Biomedical Progress”, Adam Green (applying DL scaling law paradigm to bio)
-
“AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model”, et al 2022; “SAP: Bidirectional Language Models Are Also Few-shot Learners”, et al 2022 (T5 finally does meta-learning)
-
“Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning”, et al 2022 (towards closing loops)
Genetics
Everything Is Heritable:
-
“23andMe added approximately 300,000…bringing its total number of genotyped customers to 13.1 million”; “Hospital and Drug-maker Move to Build Vast Database of New Yorkers’ DNA”
Recent Evolution:
Engineering:
-
-
“Post-Gastrulation Synthetic Embryos Generated Ex Utero from Naïve Mouse Embryonic Stem Cells”, et al 2022
-
“Embryo model completes gastrulation to neurulation and organogenesis”, et al 2022
-
“Viable offspring derived from single unfertilized mammalian oocytes”, et al 2022
-
“Mouse-embryo model derived exclusively from embryonic stem cells undergo neurulation and heart development”, et al 2022; “Stem cell-derived mouse embryos develop within an extra-embryonic yolk sac to form anterior brain regions and a beating heart”, Zernicka-et al 2022
-
“Ex vivo reconstitution of fetal oocyte development in humans and cynomolgus monkeys”, et al 2022
Statistics/Meta-Science
-
“Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?”, et al 2022 ( pre-registered studies need to specify the exact analysis for it to work)
-
“Reproducibility in the Social Sciences”, et al 2022; “It pays to be ignorant: A simple political economy of rigorous program evaluation”, 2002
Politics/Religion
Psychology/Biology
Technology
-
“When Every Ketchup But One Went Extinct: The main casualty of the catsup war was flavor” (the war over benzoates & ketchup extinction as byproduct)
Economics
Philosophy
Fiction
Miscellaneous
Books
Nonfiction:
Fiction:
Film/TV
Live-action:
Animated:
Music
MLP:
Doujin:
Misc: