June 2025 News
June 2025 Gwern.net newsletter with links on TODO
June 2025’s Gwern.net newsletter is now out; previous, May 2025 (archives). This is a collation of links and summary of major changes, overlapping with my Changelog; brought to you by my donors on Patreon.
Writings
Links
AI
“Anthropic hits $3 billion in annualized revenue on business demand for AI”
“Natural Language Processing (Almost) from Scratch”, et al 2011 (training windowed MLPs for NLP tasks on 0.8b word corpus: “Can we learn…the world by leveraging the 0.2 BPC that separate humans from n-grams?”)
“How Much Energy Does It Take To Think?” (the extreme 1:20 human brain ratio of maintenance/online-learning vs active thinking)
“The Rationale-Shaped Hole At The Heart Of Forecasting” (did any of the AI prediction markets or forecasting contests about AI scaling/trends do any good?)
Genetics
Everything Is Heritable:
“Deep learning based phenotyping of medical images improves power for gene discovery of complex disease”, et al 2023
Recent Evolution:
Engineering:
Statistics/Meta-Science
“The Black Hole Case: The Injunction Against the End of the World”, 2009
“Delphi method”: iteratively elicit predictions+rationales from experts to go beyond narrow quantitative forecasts like prediction markets
Politics/Religion
“Q1 AI Benchmarking Results: Pros Crush Bots”, 2025 (“…most important factor for good forecasting is the base model”); “Pitfalls of Evaluating Language Model Forecasters”, et al 2025 (reasons to doubt LLM forecasting successes with current/small models: logical leaks in backtesting benchmarks, and temporal leaks in search/models)
Psychology/Biology
“Remote Instruction and Student Mental Health: Swedish Evidence from the Pandemic”, et al 2024
Peter Putnam (1927–60198738ya): the tragedy of a forgotten early philosopher of model-free RL / predictive processing neuroscience
Technology
Economics
Philosophy
Henri, le Chat Noir (“I have no opposable thumbs. Yet I oppose everything.”)
Books
Fiction:
Piranesi, Susanna Clarke 2020
Non-fiction:
Film/TV
Live-action:
Animated: