Bibliography (121):

1. Gwern.net newsletter (Substack subscription page)

2. ​ January 2022 News

3. ​ ‘newsletter’ directory

4. ​ Changelog

5. Gwern Branwen Creating Essays on Gwern.net

6. ​ Design Of This Website § Backlink

7. Articles from ArXiv.org As Responsive HTML5 Web Pages

8. paragraphizer.py

9. Contracts in the Age of Smart Readers

10. Automated Crossword Solving

11. https://crypko.ai/

12. ML Scaling subreddit

13. Decision Transformer: Reinforcement Learning via Sequence Modeling

14. Gato: A Generalist Agent

15. Multi-Game Decision Transformers

16. ​ ‘MARL’ directory

17. MAT: Multi-Agent Reinforcement Learning is a Sequence Modeling Problem

18. Offline Pre-trained Multi-Agent Decision Transformer: One Big Sequence Model Tackles All SMAC Tasks

19. ​ ‘RL exploration’ directory

20. ODT: Online Decision Transformer

21. Towards Learning Universal Hyperparameter Optimizers with Transformers

22. Do As I Can, Not As I Say (SayCan): Grounding Language in Robotic Affordances

23. Inner Monologue: Embodied Reasoning through Planning with Language Models

24. PaLM: Scaling Language Modeling with Pathways

25. LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action

26. A Roadmap for Big Model

27. Anthropic Raises $124 Million to Build More Reliable, General AI Systems

28. Introducing Adept

29. Adept Video Demo!

30. ​ Why Tool AIs Want to Be Agent AIs

31. We Are Conjecture, A New Alignment Research Startup

32. AMA Conjecture, A New Alignment Startup

33. Chinchilla: Training Compute-Optimal Large Language Models

34. Flamingo: a Visual Language Model for Few-Shot Learning

35. Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance

36. PaLM § Figure 19: [Explaining a Joke / Inference Chaining] Each ‘Input” Was Independently Prepended With the Same 2-Shot Exemplar Shown at the Top, and “Model Output’ Shows the Greedy Decoding Output of PaLM 540B. The Two Exemplar Jokes Are Known Jokes (Explanations Written by Authors), While All Evaluated Jokes Were Written by the Authors. Of Course, These Jokes Do Share Abstract Premises With Existing Jokes (Wordplay, Reliability, Humorous Analogies, Reversal-Of-Expectations). The Inference Chaining Examples Were Also Written by the Authors.

37. Exploring the Limits of Language Modeling § 5.9: Samples from the Model

38. UL2: Unifying Language Learning Paradigms

39. OPT: Open Pre-trained Transformer Language Models

40. Pathways: Asynchronous Distributed Dataflow for ML

41. Singularity: Planet-Scale, Preemptive and Elastic Scheduling of AI Workloads

42. https://www.nature.com/articles/s41588-022-01016-z

43. Genetics, leadership position, and well-being: An investigation with a large-scale GWAS

44. https://www.nature.com/articles/s41591-022-01735-0

45. https://www.science.org/content/article/scientists-say-they-can-read-nearly-whole-genome-ivf-created-embryo

46. An extra-uterine system to physiologically support the extreme premature lamb

47. FDA Approves First CRISPR Cows For Beef

48. Evolutionary Biology and Gene Editing of Cat Allergen, Fel d 1

49. A CRISPR Kitty? Gene Editing Breathes New Life into the Hypoallergenic Cat

50. The Next Weird Way We’re Changing Cats: What if you could make your cat hypoallergenic with biotechnology?

51. ​ ‘cat allergies’ directory

52. ​ ‘cat-allergen antibody’ directory

53. The creator of the CRISPR babies has been released from a Chinese prison: He Jiankui created the first gene-edited children. The price was his career. And his freedom.

54. Selection for long and short sleep duration in Drosophila melanogaster reveals the complex genetic network underlying natural variation in sleep

55. https://www.quantamagazine.org/in-test-tubes-rna-molecules-evolve-into-a-tiny-ecosystem-20220505/

56. Inside the Virus-Hunting Nonprofit at the Center of the Lab-Leak Controversy

57. A Systematic Review of Human Challenge Trials, Designs, and Safety

58. Your Book Review: Making Nature

59. Amateur hour: Improving knowledge diversity in psychological and behavioral science by harnessing contributions from amateurs

60. Overhang

61. Maximum overhang

62. Adventures in Stacking

63. https://erich-friedman.github.io/packing/squinsqu/

64. Packing Unit Squares in Squares: A Survey and New Results

65. Large-scale cooperation in small-scale foraging societies

66. Contrasting Concepts of Harmony in Architecture

67. https://worksinprogress.co/issue/the-beauty-of-concrete/

68. Safety, tolerability, pharmacokinetics, and pharmacodynamics of concomitant administration of multiple doses of cagrilintide with semaglutide 2.4mg for weight management: a randomized, controlled, phase 1b trial

69. Lilly’s tirzepatide delivered up to 22.5% weight loss in adults with obesity or overweight in SURMOUNT-1

70. Tirzepatide Once Weekly for the Treatment of Obesity

71. FDA approves Lilly’s Mounjaro™ (tirzepatide) injection, the first and only GIP and GLP-1 receptor agonist for the treatment of adults with type 2 diabetes

72. Weight regain and cardiometabolic effects after withdrawal of semaglutide: the STEP 1 trial extension

73. Unimolecular Polypharmacy for Treatment of Diabetes and Obesity

74. Deep Phenotyping and Lifetime Trajectories Reveal Limited Effects of Longevity Regulators on the Aging Process in C57BL/6J Mice

75. https://www.nature.com/articles/s43587-022-00357-y

76. Best Font for Online Reading: No Single Answer

77. https://dl.acm.org/doi/10.1145/3502222

78. http://tom7.org/papers/murphy2022harder.pdf

79. Harder Drive: Hard Drives We Didn’t Want or Need

80. SIGBOVIK 2022

81. ‘I think I discovered a military base in the middle of the ocean’—Null Island, the most real of fictional places

82. https://www.nature.com/articles/s41598-022-09694-9

83. The Soviet Problem with Two ‘Unknowns’: How an American Architect and a Soviet Negotiator Jump-Started the Industrialization of Russia, Part I: Albert Kahn

84. The Soviet Problem with Two ‘Unknowns’: How an American Architect and a Soviet Negotiator Jump-Started the Industrialization of Russia, Part II: Saul Bron

85. Will Studying Economics Make You Rich? A Regression Discontinuity Analysis of the Returns to College Major

86. From Stroke to Stoke: The Multiple Sporting Legacies of the Southern California Home Swimming Pool

87. Prologue

88. A Practical Guide to Evil (Literature)

89. Stand Still. Stay Silent

90. Stand Still, Stay Silent (Webcomic)

91. Possible Girls

92. Green Knight Disses Glory

93. https://www.vanityfair.com/hollywood/2021/07/green-knight-ending-explained-does-he-die-gawain-dev-patel

94. ​ opera#the-ring-cycle

    [Transclude the forward-link's context]

95. Wikipedia Bibliography:

    1. Neural scaling law  :

       https://en.wikipedia.org/wiki/Neural_scaling_law

    2. Human challenge study

    3. Cell (journal)  :

       https://en.wikipedia.org/wiki/Cell_(journal)

    4. Nature (journal)  :

       https://en.wikipedia.org/wiki/Nature_(journal)

    5. Science (journal)

    6. Block-stacking problem

    7. Square packing  :

       https://en.wikipedia.org/wiki/Square_packing

    8. Peter Eisenman  :

       https://en.wikipedia.org/wiki/Peter_Eisenman

    9. Christopher Alexander  :

       https://en.wikipedia.org/wiki/Christopher_Alexander

    10. Modern architecture  :

        https://en.wikipedia.org/wiki/Modern_architecture

    11. Hobby tunneling

    12. Belyana  :

        https://en.wikipedia.org/wiki/Belyana

    13. Silurian hypothesis  :

        https://en.wikipedia.org/wiki/Silurian_hypothesis

    14. World's Columbian Exposition  :

        https://en.wikipedia.org/wiki/World%27s_Columbian_Exposition

    15. Stand Still, Stay Silent  :

        https://en.wikipedia.org/wiki/Stand_Still,_Stay_Silent

    16. 1811–1812 New Madrid earthquakes  :

        https://en.wikipedia.org/wiki/1811%E2%80%931812_New_Madrid_earthquakes

    17. Wheel-well stowaway  :

        https://en.wikipedia.org/wiki/Wheel-well_stowaway

    18. Everything Everywhere All at Once § Critical response  :

        https://en.wikipedia.org/wiki/Everything_Everywhere_All_at_Once#Critical_response

    19. The Green Knight (film)  :

        https://en.wikipedia.org/wiki/The_Green_Knight_(film)

    20. Sir Gawain and the Green Knight  :

        https://en.wikipedia.org/wiki/Sir_Gawain_and_the_Green_Knight

    21. David Lowery (director)  :

        https://en.wikipedia.org/wiki/David_Lowery_(director)

    22. Morgan le Fay  :

        https://en.wikipedia.org/wiki/Morgan_le_Fay

    23. Gawain  :

        https://en.wikipedia.org/wiki/Gawain

    24. Green Knight  :

        https://en.wikipedia.org/wiki/Green_Knight

    25. Punch and Judy  :

        https://en.wikipedia.org/wiki/Punch_and_Judy

    26. Saint Winifred  :

        https://en.wikipedia.org/wiki/Saint_Winifred

    27. A Connecticut Yankee in King Arthur’s Court