AI

• “Champion-level drone racing using deep reinforcement learning”, Kaufmann et al 2023

• “Creativity Has Left the Chat: The Price of Debiasing Language Models”, Mohammedi2024 (documenting the severe mode collapse & loss of diversity in possible completions in RLHF-tuned LLMs—how much does this impede any attempt at search or planning using LLMs…?); “Consistency-diversity-realism Pareto fronts of conditional image generative models”, Astolfi et al 2024

• “Equitable Legal Remedies and the Existential Threat to Generative AI”, Joh2023 (argues US federal copyright courts have the power to order AI models outright erased & have done similar things before)

• “Robot developed by Ben Katz & Jared Di Carlo can solve Rubik’s Cube in record-breaking 0.38s” (the power of high-speed robotics & computer vision; unmodified, using a Lego robot instead: 1.8s; for comparison, the human all-time world record is 3.13s, or 2–8× slower.)

Matters Of Scale:

• on Chinese AI: Where did all the Chinese Internet tokens go?; race-to-the-bottom price wars among Chinese LLMs; “China Is Losing the Chip War. Xi Jinping picked a fight over semiconductor technology—one he can’t win”; “For Chinese Students, the New Tactic Against AI Checks: More AI”/“Research misconduct in China: towards an institutional analysis”, Zhang & Wang2024 (the fish rots from the head); “We simply need to turn the quantity of published articles into quality” —Zhang Hongjiang

• Anthropic releases Claude-3.5-sonnet, Opus to follow

• Ilya Sutskever launches ‘Safe Superintelligence’, a new startup to race for AGI by scaling LLMs

• “AI Deception: A Survey of Examples, Risks, and Potential Solutions”, Park et al 2023; “Hoodwinked: Deception and Cooperation in a Text-Based Game for Language Models”, O’Gara2023; “Deception abilities emerged in large language models”, Hagendorff2024 (LLMs given goals & inner-monologue increasingly can manipulate); “Reward hacking behavior can generalize across tasks”, Nishimura-Gasparian et al 2024; “Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models”, Denison et al 2024

• “A Theory for Emergence of Complex Skills in Language Models”, Arora & Goyal2023; “A Solvable Model of Neural Scaling Laws”, Maloney et al 2022

• “Takeoff speeds presentation”, Tom Davidson2023-09

• “Trading off compute in training and inference: We explore several techniques that induce a tradeoff between spending more resources on training or on inference and characterize the properties of this tradeoff. We outline some implications for AI governance”, EpochAI

• “Robust agents learn causal world models”, Richens & Everitt2024; “A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Task”, Brinkmann et al 2024 (Transformers can do internal planning in the forward pass)

• “How AlphaFold Revolutionized Protein Science, but Didn’t End It”

• “No physics? No problem. AI weather forecasting is already making huge strides. New model that predicts global weather can run on a single desktop computer.”

• “Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations”, Zhai et al 2024 (more power-law scaling of recommenders)

• “A Benchmark for Learning to Translate a New Language from One Grammar Book”, Tanzer et al 2023

• “Kasparov versus the World” (extreme diminishing returns to human coordination: 50k+ chess players + several IM/GMs couldn’t beat him!)

Genetics

Everything Is Heritable:

Recent Evolution:

Engineering:

• “MIT researchers ordered and combined parts of the 1918 pandemic influenza virus. Did they expose a security flaw?”

Statistics/Meta-Science

• “Will we continue scientific research?”, Alexander Grothendieck1972 (on the future & morality of science)

• “Scientists Who Fund Themselves”, Cohen1998

• Requests For Comment/Jagged_85: Evidence (If you ever feel confident about what you ‘know’ about the Islamic medieval period bc you “just love reading Wikipedia”, you may want to know that in 2010, a crazy person spent 3 years falsifying hundreds of claims of Islamic invention, everything from “p-n junctions” to “capitalism”. He was banned in 2012, but it’s unclear how many falsehoods were left, whether he was using any other socks or anon IPs, why, what he has spent the past 12 years doing, or how far his claims have been carried by citogenesis or fellow Islamic ideologues. cf. Historia Augusta)

Politics/Religion

• “The Beliefs of the Blob”, Fettweis2023 (how the US military-industrial complex sees the world & threats like China); Profile of the US State Department’s INR (a dissident intelligence agency whose predictions often differ from the rest of the Blob)

• “Intergenerational Mobility in American History: Accounting for Race and Measurement Error”, Ward2023

• “The unexpected origins of a modern finance tool: Discounting calculations are ubiquitous today — thanks partly to the English clergy who spread them amid turmoil in the 1600s, an MIT scholar shows” (Deringer2024; formal NPV estimates as mechanism for negotiation)

• “Samsara”, Scott Alexander

• Rex Nemorensis

Psychology/Biology

• “Language is primarily a tool for communication rather than thought”, Fedorenko et al 2024 (still no complex cognition that requires thought, similar to Protzko & Colom2021 failing to find any unique brain region critical to fluid intelligence. More evidence that while language is neither necessary nor sufficient for cognitive abilities, what it may be is critical for development: it is scaffolding. Language is efficient communication of knowledge which enables faster development. Anything learned with language can be learned without language, and once learned, language can be kicked away, like a ladder—but learning without language is slower, and will result in less per lifetime, and then what has been learned cannot be easily shared or preserved, so no accumulating ratchet either.)

• “Social Status and Unethical Behavior: Two Replications of the Field Studies in Piff et al 2012”, Jung et al 2023 (failure to replicate claims the rich are more unethical)

• “Ig Nobel Prize Winner Higashiyama Atsuki and the ‘Between-Legs Effect’ Mystery”

• “True Porn Clerk Stories”, Ali Davis2002

Technology

• The OceanGate disaster: how a charismatic high-tech startup CEO defied repeated correct predictions of disaster & created normalization of deviance by pushing to ship, inadequate testing, lying, firing dissenters, & gagging whistleblowers with NDAs (killing 5)

• World-Wide Labyrinth Locator

• “Repairing my mug with Kintsugi”, Fredrik Flornes Ellertsen2024

• Molecule of the Month

Economics

• “Microsoft Refused to Fix Flaw Years Before SolarWinds Hack” (normalization of deviance in large AI-related organizations: MS covered up the flaw that enabled Russia to extensively hack MS & the US federal government, pushed by Satya Nadella to sell cloud services)

• “The Gender Gap in Confidence: Expected but Not [Fully] Accounted For”, Exley & Nielsen2024

• “From Fire Hazards to Family Trees: The Sanborn Fire Insurance Maps”; “All That Is Solid Bursts into Flame: Capitalism and Fire in the Nineteenth-Century United States”, Immerwahr2024

Philosophy

Fiction

• “Can Poetry Matter? Poetry has vanished as a cultural force in America. If poets venture outside their confined world, they can work to make it essential once more”, Dana Gioia1991

• “The Golden Boy”, Gaiman1993 (rebuttal to “Watchmaker”)

• “Extreme D&D DIY: adventures in hypergeometry, procedural generation, and software development (part 1)”, Said Achmiz2024 (modeling inter-dimensional invasion properly with higher-dimensional geometry for a D&D campaign)

Miscellaneous