Bibliography:

  1. doc tag

  2. /doc/existential-risk/nuclear/hofstadter

  3. ‘nuclear war’ tag

  4. ‘genome synthesis’ tag

  5. ‘AI safety’ tag

  6. Why Tool AIs Want to Be Agent AIs

  7. A US Engineer Had a Shocking Plan to Improve the Climate—Burn All Coal on Earth

  8. Remarks by Vice President Harris on the Future of Artificial Intelligence London, United Kingdom

  9. ec562affbe518297d6fbf9c48903a1fb3ca520bc.html

  10. Will releasing the weights of large language models grant widespread access to pandemic agents?

  11. Lessons For Humanity From The Extinction Of The Dinosaurs

  12. One Small Step for Man, One Giant Leap for Moon Microbes? Interpretations of Risk and the Limits of Quarantine in NASA’s Apollo Program

  13. ChemCrow: Augmenting large-language models with chemistry tools

  14. Impact of the Tambora volcanic eruption of 1815 on islands and relevance to future sunlight-blocking catastrophes

  15. Is it possible to prepare for a pandemic?

  16. DeepMind: The Podcast—Excerpts on AGI

  17. Joan Rohlfing on how to avoid catastrophic nuclear blunders: The interaction between nuclear weapons and cybersecurity

  18. Synthetic fat from petroleum as a resilient food for global catastrophes: Preliminary techno-economic assessment and technology roadmap

  19. Results of a 2020 Survey on Reporting Requirements and Practices for Biocontainment Laboratory Accidents

  20. Late-time small body disruptions for planetary defense

  21. A Global Nucleic Acid Observatory for Biodefense and Planetary Health

  22. Photovoltaic-driven microbial protein production can use land and sunlight more efficiently than conventional crops

  23. Goal Misgeneralization in Deep Reinforcement Learning

  24. Putting the humanity into inhuman systems: How human factors and ergonomics can be used to manage the risks associated with artificial general intelligence

  25. The Timing of Evolutionary Transitions Suggests Intelligent Life Is Rare

  26. Possible takeaways from the coronavirus pandemic for slow AI takeoff

  27. Counterproductive Altruism: The Other Heavy Tail

  28. What Intellectual Progress Did I Make In The 2010s?

  29. 2019 AI Alignment Literature Review and Charity Comparison

  30. The Vulnerable World Hypothesis

  31. DeepMind and Google: the battle to control artificial intelligence. Demis Hassabis founded a company to build the world’s most powerful AI. Then Google bought him out. Hal Hodson asks who is in charge

  32. Forecasting Transformative AI: An Expert Survey

  33. The Psychology of Existential Risk: Moral Judgments about Human Extinction

  34. Dissolving the Fermi Paradox

  35. The Silurian Hypothesis: Would it be possible to detect an industrial civilization in the geological record?

  36. The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities

  37. Multiverse-wide Cooperation via Correlated Decision Making

  38. There’s No Fire Alarm for Artificial General Intelligence

  39. Some Key Ways Which I'Ve Changed My Mind Over The Last Several Years

  40. The Singularity: A Philosophical Analysis

  41. Singularity and Inevitable Doom

  42. Doing Enough

  43. Metamagical Themas: Sanity and Survival

  44. Bayesian analysis of the astrobiological implications of life’s early emergence on Earth

  45. Intelligence Explosion: Evidence and Import

  46. Chapter 13: Corporations

  47. Aum Shinrikyo: Insights Into How Terrorists Develop Biological and Chemical Weapons

  48. On the Origin and Evolution of Life in the Galaxy

  49. Alexander Kruel’s AI Risk Interview Series (2011–2013)

  50. 1eee672ca3c1accc84ba7b80894352dde3df0ee1.html

  51. Anthropic Shadow: Observation Selection Effects and Human Extinction Risks

  52. Myopic Voters and Natural Disaster Policy

  53. The Unabomber Was Right

  54. The physical principles of thermonuclear explosives, inertial confinement fusion, and the quest for fourth generation nuclear weapons

  55. Probing the Improbable: Methodological Challenges for Risks with Low Probabilities and High Stakes

  56. Implications of an Anthropic Model of Evolution for Emergence of Complex Life and Intelligence

  57. The Optimistic Thought Experiment

  58. The Nuclear Taboo: The United States and the Non-Use of Nuclear Weapons Since 1945

  59. Five or six step scenario for evolution?

  60. Aberrant innate immune response in lethal infection of macaques with the 1918 influenza virus

  61. Forbidden Knowledge

  62. Must Early Life Be Easy? The Rhythm of Major Evolutionary Transitions

  63. Mathematics on a Distant Planet

  64. The Sverdlovsk Anthrax Outbreak of 1979

  65. Implications of the Copernican principle for our future prospects

  66. The Logic of Failure [and Discussion]

  67. Nuclear Fission: Reaction to the Discovery in 1939

  68. Metamagical Themas: Sanity and Survival

  69. The anthropic principle and its implications for biological evolution

  70. The loving parent meets the selfish gene

  71. Rejoinder to Gray and Wolfe

  72. Human tragedy and natural selection

  73. Large Number Coincidences and the Anthropic Principle in Cosmology

  74. All You Ever Wanted to Know about MIRV and ICBM Calculations but Were Not Cleared to Ask

  75. Speculations Concerning the First Ultraintelligent Machine

  76. Can We Survive Technology?

  77. Don’t Worry—It Can’t Happen

  78. Alleged Sins of Science

  79. David Denkenberger on Using Paper Mills and Seaweed to Feed Everyone in a Catastrophe, Ft Sahil Shah

  80. bfa75540cc1e2f58ffb9c5ecda55d1a8866513cf.html

  81. 2022 Expert Survey on Progress in AI

  82. Looking Back at the Future of Humanity Institute

  83. Book Review: Barriers to Bioweapons

  84. Detecting Genetically Engineered Viruses With Metagenomic Sequencing

  85. 1972 Talk at CERN on Scientific Research

  86. 2017: Universal Paperclips

  87. Homepage of Paul F. Christiano

  88. Envisioning a World Immune to Global Catastrophic Biological Risks

  89. 8712cb576a75eb7233bc965bf07df71400121801.html

  90. MIT Researchers Ordered and Combined Parts of the 1918 Pandemic Influenza Virus. Did They Expose a Security Flaw?

  91. Thomas Moynihan—Homepage

  92. Apocalyptic Log

  93. The Dangers of Mirrored Life

  94. Your Book Review: The Family That Couldn’t Sleep

  95. Forget about Drones, Forget about Dystopian Sci-Fi—A Terrifying New Generation of Autonomous Weapons Is Already Here. Meet the Small Band of Dedicated Optimists Battling Nefarious Governments and Bureaucratic Tedium to Stop the Proliferation of Killer Robots And, Just Maybe, save Humanity from Itself.

  96. Optimality Is the Tiger, and Agents Are Its Teeth

  97. Liability Regimes for AI

  98. We Know Lab Leaks Are Possible, and One Could Start a New Pandemic

  99. design#future-tag-features

    [Transclude the forward-link's context]

  100. 2017-barrett.pdf

  101. 2016-lipsitch.pdf

  102. 2011-05-10-givewell-holdenkarnofskyjaantallinn.doc

  103. 1990-dansimmons-thefallofhyperion-ch41-ummonquotesoceanus.png

  104. 1985-hofstadter-guillotine.png

  105. https://80000hours.org/podcast/episodes/tom-moynihan-prior-generations/

  106. https://antiapocalyptus.substack.com/p/interview-thomas-moynihan-the-discovery

  107. https://blog.nuclearsecrecy.com/2012/09/12/in-search-of-a-bigger-boom/

  108. fe603907cb1711f5d9f0ef2421c783a727553aa0.html

  109. https://bounded-regret.ghost.io/base-rates-of-catastrophes/

  110. ab61644f5ab9cfb5d72863a3b5bb0aafc0fbb71d.html

  111. https://constructionphysics.substack.com/p/could-we-stop-yellowstone-from-erupting

  112. https://forum.effectivealtruism.org/posts/PTtZWBAKgrrnZj73n/biosecurity-culture-computer-security-culture

  113. https://neal.fun/days-since-incident/

  114. https://neo.ssa.esa.int/risk-list

  115. ac2ad92bd71750ab93b2509cb5dfa138aeacf797.html

  116. https://www.astralcodexten.com/p/the-extinction-tournament

  117. https://www.bbc.com/future/article/20210929-creatures-of-the-dawn-how-radioactivity-unlocked-deep-time

  118. https://www.newyorker.com/news/annals-of-a-warming-planet/what-to-do-with-climate-emotions

  119. https://www.openphilanthropy.org/research/detection-of-near-earth-asteroids/

  120. https://www.reddit.com/r/unsong/comments/zckyg0/completing_edward_tellers_atom_alphabet_with/

  121. https://www.science.org/doi/10.1126/science.ads9158

  122. https://www.thelancet.com/journals/lanmic/article/PIIS2666-5247(23)00319-1/fulltext

  123. https://www.wired.com/story/synthetic-dna-us-biden-regulation/

  124. https://xkcd.com/795/

  125. DeepMind: The Podcast—Excerpts on AGI

  126. https%253A%252F%252Fwww.lesswrong.com%252Fposts%252FSbAgRYo8tkHwhd9Qx%252Fdeepmind-the-podcast-excerpts-on-agi.html

  127. Joan Rohlfing on how to avoid catastrophic nuclear blunders: The interaction between nuclear weapons and cybersecurity

  128. https%253A%252F%252F80000hours.org%252Fpodcast%252Fepisodes%252Fjoan-rohlfing-avoiding-catastrophic-nuclear-blunders%252F%2523the-interaction-between-nuclear-weapons-and-cybersecurity-011018.html

  129. The Timing of Evolutionary Transitions Suggests Intelligent Life Is Rare

  130. https%253A%252F%252Fwww.liebertpub.com%252Fdoi%252Ffull%252F10.1089%252Fast.2019.2149.html

  131. 2019 AI Alignment Literature Review and Charity Comparison

  132. https%253A%252F%252Fwww.lesswrong.com%252Fposts%252FSmDziGM9hBjW9DKmf%252F2019-ai-alignment-literature-review-and-charity-comparison.html

  133. DeepMind and Google: the battle to control artificial intelligence. Demis Hassabis founded a company to build the world’s most powerful AI. Then Google bought him out. Hal Hodson asks who is in charge

  134. https%253A%252F%252Fwww.economist.com%252F1843%252F2019%252F03%252F01%252Fdeepmind-and-google-the-battle-to-control-artificial-intelligence.html

  135. Metamagical Themas: Sanity and Survival

  136. %252Fdoc%252Fexistential-risk%252F1985-hofstadter.html

  137. Aum Shinrikyo: Insights Into How Terrorists Develop Biological and Chemical Weapons

  138. %252Fdoc%252Fcrime%252Fterrorism%252F2011-danzig.pdf.html

  139. Forbidden Knowledge

  140. %252Fdoc%252Fphilosophy%252Fethics%252F2005-kempner.pdf.html

  141. Speculations Concerning the First Ultraintelligent Machine

  142. %252Fdoc%252Fai%252F1966-good.pdf.html

  143. Homepage of Paul F. Christiano

  144. https%253A%252F%252Fpaulfchristiano.com%252F.html