December 2022 Gwern.net newsletter with links on TODO
December 2022’s Gwern.net newsletter is now out; previous, November 2022 (archives). This is a collation of links and summary of major changes, overlapping with my Changelog; brought to you by my donors on Patreon.
Writings
-
N/A
Links
AI
-
Google Waymo begins full, driver-less, commercial self-driving cars in SF (and Phoenix airport)
-
“waifu-diffusion” (Stable Diffusion v1.4 finetuned on 56k Danbooru image-text pairs for text); Prototype non-SD text2image Danbooru anime diffusion model
-
“Do large language models know chemistry?”, et al 2022 ( GPT-3 solves chemistry better when copyright notices added to prompt) / “Do Large Language Models Understand Chemistry? A Conversation with ChatGPT”, 2023; “GPT Takes the Bar Exam”, 2022; “GPT as Knowledge Worker: A Zero-Shot Evaluation of AI CPA Capabilities”, et al 2023; “Can large language models reason about medical questions?”, et al 2022/ “Performance of ChatGPT on USMLE: Potential for AI-Assisted Medical Education Using Large Language Models”, et al 2022; “Large Language Models Encode Clinical Knowledge”, et al 2022 ( Flan-PaLM → Med-PaLM); “How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection”, et al 2023; “Large Language Models as Fiduciaries: A Case Study Toward Robustly Communicating With Artificial Intelligence Through Legal Standards”, 2023 (U-shaped scaling); “Predicting Consumer Contracts [With GPT-3]”, 2022; “Is ChatGPT a General-Purpose Natural Language Processing Task Solver?”, et al 2023; “GPT-4 Takes a New Midterm and Gets an A”, Bryan Caplan; “How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment”, et al 2023; “Beyond the Pass Mark: the Accuracy of ChatGPT and Bing in the National Medical Licensure Examination in Japan”, 2023
-
“Introducing Whisper”, OpenAI 2022 (et al 2022 ; released checkpoints for extreme multilingual near-human-level robustness and accuracy on ASR from 680k hours of multilingual supervised audio data—an obvious source of text data, and perhaps the fluency of Whisper ASR errors is a good thing?); “SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Network”, et al 2021
-
“Emergent Analogical Reasoning in Large Language Models”, et al 2022 (encoding RAPM IQ test into number grid to test GPT-3)
Genetics
Everything Is Heritable:
Recent Evolution:
Engineering:
Statistics/Meta-Science
Politics/Religion
Psychology/Biology
-
“In-Person Schooling and Youth Suicide: Evidence from School Calendars and Pandemic School Closures”, et al 2022; “Trends and Seasonality of Emergency Department Visits and Hospitalizations for Suicidality Among Children and Adolescents in the US from 2016 to 2021”, et al 2023 (teen suicide decreased when schools closed during COVID-19)
-
Hideyo Noguchi, discoverer of bacterial cause of syphilis (the thin line between criminal fraud & humanitarian genius)
Technology
-
Recursive Life in Life (HN; zoom out one step at a time to see the OTCA metapixel at work)
-
Nano tape (nanotape is magical to use—I would’ve loved this stuff as a kid: it is sticky, yet has no sticky stuff. It’s absurdly strong, you can stretch/squeeze it, you can reuse it, you can even wash it if it gets dirty, it’s transparent… What could I have done with this & Legos?)
Economics
Philosophy
Fiction
Miscellaneous
Books
Nonfiction:
Fiction:
Film/TV
Live-action:
Animated:
Music
MLP:
Doujin:
Misc: