Bibliography (186):

1. Gwern.net newsletter (Substack subscription page)

2. ​ November 2021 News

3. ​ ‘newsletter’ directory

4. ​ Changelog

5. Gwern Branwen Creating Essays on Gwern.net

6. https://openai.com/blog/introducing-text-and-code-embeddings/

7. Text and Code Embeddings by Contrastive Pre-Training

8. https://platform.openai.com/docs/guides/embeddings/use-cases

9. Learning robust perceptive locomotion for quadrupedal robots in the wild

10. Rapid Locomotion via Reinforcement Learning

11. Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotion

12. Robot peels banana with goal-conditioned dual-action deep imitation learning

13. Robot Peels Banana With Deep Learning, UT ISI Lab

14. Automated Reinforcement Learning (AutoRL): A Survey and Open Problems

15. M5 accuracy competition: Results, findings, and conclusions

16. StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

17. Alias-Free Generative Adversarial Networks

18. Progressive Growing of GANs for Improved Quality, Stability, and Variation

19. Projected GANs Converge Faster

20. Vision Transformer: An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale

21. In vitro neurons learn and exhibit sentience when embodied in a simulated game-world

22. https://community.arm.com/arm-community-blogs/b/high-performance-computing-blog/posts/deep-learning-episode-4-supercomputer-vs-pong-ii

23. Podracer architectures for scalable Reinforcement Learning

24. Word Golf

25. ML Scaling subreddit

26. ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

27. ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

28. CTRL: A Conditional Transformer Language Model For Controllable Generation

29. Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learning

30. WebGPT: Browser-assisted question-answering with human feedback

31. WebGPT: Improving the factual accuracy of language models through web browsing

32. Openai/universe: Universe: a Software Platform for Measuring and Training an AI's General Intelligence across the World's Supply of Games, Websites and Other Applications.

33. ​ Why Tool AIs Want to Be Agent AIs

34. https://ai.meta.com/blog/harmful-content-can-evolve-quickly-our-new-ai-system-adapts-to-tackle-it/

35. Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases

36. Improving language models by retrieving from trillions of tokens

37. A Mathematical Framework for Transformer Circuits

38. In-Context Learning and Induction Heads

39. Magna Alta Doctrina

40. Brain Efficiency: Much More Than You Wanted to Know

41. AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts

42. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey

43. Mining for strong gravitational lenses with self-supervised learning

44. https://www.reddit.com/r/mlscaling/comments/rjkypd/lgs_exaone_a_300bparameter_multimodal_transformer/hp4bb6v/

45. L-Verse: Bidirectional Generation Between Image and Text

46. Introducing the AI Research SuperCluster—Facebook’s cutting-edge AI supercomputer for AI research

47. LaMDA: Language Models for Dialog Applications

48. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

49. ​ scaling-hypothesis#blessings-of-scale

    [Transclude the forward-link's context]

50. ​ ‘inner monologue (AI)’ directory

51. Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision

52. Announcing GPT-NeoX-20B

53. Moore’s Law, AI, and the pace of Progress

54. Kakaobrain/mindall-E: PyTorch Implementation of a 1.3B Text-To-Image Generation Model Trained on 14 Million Image-Text Pairs

55. Conceptual Captions: A Cleaned, Hypernymed, Image Alt-text Dataset For Automatic Image Captioning

56. A comprehensive map of genetic relationships among diagnostic categories based on 48.6 million relative pairs from the Danish genealogy

57. Genome-wide analyses of ADHD identify 27 risk loci, refine the genetic architecture and implicate several cognitive domains

58. Genome-wide association meta-analysis identifies 29 new acne susceptibility loci

59. Every Pore on Your Face Is a Walled Garden

60. Haploidy in somatic cells is induced by mature oocytes in mice

61. https://www.science.org/content/article/this-scientist-accused-supplement-industry-of-fraud-now-his-own-work-is-under-fire

62. https://statmodeling.stat.columbia.edu/2022/08/28/the-latest-scientific-fraud-story-as-is-so-often-the-case-people-had-been-warning-us-about-this-guy-for-a-long-time-but-the-people-in-charge-werent-listening/

63. https://www.science.org/content/article/star-botanist-likely-made-data-about-nutritional-supplements-new-probe-finds

64. Dream Interpretation from a Cognitive and Cultural Evolutionary Perspective: The Case of Oneiromancy in Traditional China

65. Diversity Training Goals, Limitations, and Promise: A Review of the Multidisciplinary Literature

66. The evolution of quantitative sensitivity

67. Why Some Animals Can Tell More From Less: Researchers find that densely packed neurons play an outsize role in quantitative skill—calling into question old assumptions about evolution

68. Like a Lemon to a Lime, a Lime to a Lemon

69. Results of a 5-Year n-of-1 Growth Hormone Releasing Hormone Gene Therapy Experiment

70. The lungfish cocoon is a living tissue with antimicrobial functions

71. The Insights Psychedelics Give You Aren’t Always True: The study of false—sober—insights teaches us to be wary of accepting every realization from psychedelic trips without critical thinking

72. Polytetrafluoroethylene (PTFE) Ingestion as a Way to Increase Food Volume and Hence Satiety Without Increasing Calorie Content

73. Nicotine contents in some commonly used toothpastes and toothpowders: a present scenario

74. ​ 04#perfume

    [Transclude the forward-link's context]

75. ​ oldest-food

76. A Personal View of Average-Case Complexity

77. Understanding sources of inefficiency in general-purpose chips

78. From fish out of water to new insights on navigation mechanisms in animals

79. 2022-givon-goldfishdrivingvideo.mp4

80. Surprisingly Robust In-Hand Manipulation: An Empirical Study

81. A Large-Scale Characterization of How Readers Browse Wikipedia

82. The Complete, Untold History of Halo

83. Iron and The Soul by Henry Rollins

84. https://www.metopera.org/season/in-cinemas/2021-22-season/eurydice-live-in-hd/

85. Puella Magi Madoka Magica (Anime)

86. https://www.fanfiction.net/s/7406866/1/To-the-Stars

87. ​ The Explore-Exploit Dilemma in Media Consumption

88. ​ book#the-empty-box-and-the-zeroth-maria-mikage-2009

    [Transclude the forward-link's context]

89. The Making of Final Fantasy VII

90. 1973-gonagai-devilman-ryouakira-finalendingscene.jpg

91. Theory and Analysis:Final Scene in End of Evangelion

92. EoE Live Sequence and Alternate Endings

93. ​ anime#concurrency

    [Transclude the forward-link's context]

94. ​ Review of Space Battleship Yamato

95. Kemono Friends (Anime)

96. ​ MLP: Immanetizing The Equestrian

97. Kemono Friends—Opening

98. https://www.youtube.com/watch?v=FyIlS5K7WKs

99. https://x.com/abubu_newnanka

100. Kemono Friends - Raccoon-San Mansion

101. What Its Like to Become a Fan of Kemono Friends In 2020

102. Idiot Ball

103. Wikipedia Bibliography:

     1. Makridakis Competitions

     2. GloVe

     3. Word embedding

     4. Neural scaling law  :

        https://en.wikipedia.org/wiki/Neural_scaling_law

     5. LG  :

        https://en.wikipedia.org/wiki/LG

     6. October Crisis  :

        https://en.wikipedia.org/wiki/October_Crisis

     7. Cara cara navel  :

        https://en.wikipedia.org/wiki/Cara_cara_navel

     8. Sport (botany)

     9. Brian Hanley (microbiologist)  :

        https://en.wikipedia.org/wiki/Brian_Hanley_(microbiologist)

     10. Clitoria  :

         https://en.wikipedia.org/wiki/Clitoria

     11. Voice confrontation  :

         https://en.wikipedia.org/wiki/Voice_confrontation

     12. Penis fencing  :

         https://en.wikipedia.org/wiki/Penis_fencing

     13. Love dart  :

         https://en.wikipedia.org/wiki/Love_dart

     14. Traumatic insemination  :

         https://en.wikipedia.org/wiki/Traumatic_insemination

     15. Fischer–Tropsch process § History  :

         https://en.wikipedia.org/wiki/Fischer%E2%80%93Tropsch_process#History

     16. Carbon capture  :

         https://en.wikipedia.org/wiki/Carbon_capture

     17. Bog butter  :

         https://en.wikipedia.org/wiki/Bog_butter

     18. K Foundation Burn a Million Quid  :

         https://en.wikipedia.org/wiki/K_Foundation_Burn_a_Million_Quid

     19. Government cheese  :

         https://en.wikipedia.org/wiki/Government_cheese

     20. Butter mountain  :

         https://en.wikipedia.org/wiki/Butter_mountain

     21. Wine lake  :

         https://en.wikipedia.org/wiki/Wine_lake

     22. Henry Rollins  :

         https://en.wikipedia.org/wiki/Henry_Rollins

     23. Black Flag (band)  :

         https://en.wikipedia.org/wiki/Black_Flag_(band)

     24. Howard Stern  :

         https://en.wikipedia.org/wiki/Howard_Stern

     25. Murder of Joe Cole  :

         https://en.wikipedia.org/wiki/Murder_of_Joe_Cole

     26. Blade of the Immortal  :

         https://en.wikipedia.org/wiki/Blade_of_the_Immortal

     27. Masamune Shirow

     28. Ghost in the Shell (manga)

     29. Dune (2021 film)  :

         https://en.wikipedia.org/wiki/Dune_(2021_film)

     30. Fire Shut Up in My Bones  :

         https://en.wikipedia.org/wiki/Fire_Shut_Up_in_My_Bones

     31. Eurydice (Aucoin)  :

         https://en.wikipedia.org/wiki/Eurydice_(Aucoin)

     32. Boris Godunov (opera)  :

         https://en.wikipedia.org/wiki/Boris_Godunov_(opera)

     33. The Third Man  :

         https://en.wikipedia.org/wiki/The_Third_Man

     34. The Cabinet of Dr. Caligari  :

         https://en.wikipedia.org/wiki/The_Cabinet_of_Dr._Caligari

     35. Film noir  :

         https://en.wikipedia.org/wiki/Film_noir

     36. M (1931 film)  :

         https://en.wikipedia.org/wiki/M_(1931_film)

     37. Puella Magi Madoka Magica

     38. Gen Urobuchi  :

         https://en.wikipedia.org/wiki/Gen_Urobuchi

     39. Good Friday  :

         https://en.wikipedia.org/wiki/Good_Friday

     40. 2011 Tōhoku earthquake and tsunami

     41. Puella Magi Madoka Magica: The Movie § Rebellion  :

         https://en.wikipedia.org/wiki/Puella_Magi_Madoka_Magica:_The_Movie#Rebellion

     42. Night Is Short, Walk On Girl  :

         https://en.wikipedia.org/wiki/Night_Is_Short,_Walk_On_Girl

     43. The Tatami Galaxy

     44. Masaaki Yuasa  :

         https://en.wikipedia.org/wiki/Masaaki_Yuasa

     45. Ukiyo-zōshi  :

         https://en.wikipedia.org/wiki/Ukiyo-z%C5%8Dshi

     46. Devilman Crybaby  :

         https://en.wikipedia.org/wiki/Devilman_Crybaby

     47. Devilman  :

         https://en.wikipedia.org/wiki/Devilman

     48. Go Nagai

     49. Hideaki Anno

     50. The End of Evangelion

     51. Apocatastasis  :

         https://en.wikipedia.org/wiki/Apocatastasis

     52. Ping Pong (manga)  :

         https://en.wikipedia.org/wiki/Ping_Pong_(manga)

     53. Odd Taxi  :

         https://en.wikipedia.org/wiki/Odd_Taxi

     54. Land of the Lustrous  :

         https://en.wikipedia.org/wiki/Land_of_the_Lustrous

     55. Macross: Do You Remember Love?

     56. Gleipnir (manga)  :

         https://en.wikipedia.org/wiki/Gleipnir_(manga)

     57. The Garden of Sinners

     58. Kizumonogatari  :

         https://en.wikipedia.org/wiki/Kizumonogatari

     59. Mob Psycho 100  :

         https://en.wikipedia.org/wiki/Mob_Psycho_100

     60. Super Dimension Fortress Macross

     61. Polar Bear Café  :

         https://en.wikipedia.org/wiki/Polar_Bear_Caf%C3%A9

     62. 91 Days  :

         https://en.wikipedia.org/wiki/91_Days

     63. Sweetness and Lightning  :

         https://en.wikipedia.org/wiki/Sweetness_and_Lightning

     64. Rurouni Kenshin: Trust & Betrayal  :

         https://en.wikipedia.org/wiki/Rurouni_Kenshin:_Trust_%26_Betrayal

     65. Kemono Friends  :

         https://en.wikipedia.org/wiki/Kemono_Friends

     66. MikuMikuDance  :

         https://en.wikipedia.org/wiki/MikuMikuDance

     67. Walk cycle  :

         https://en.wikipedia.org/wiki/Walk_cycle

     68. SCP Foundation  :

         https://en.wikipedia.org/wiki/SCP_Foundation

     69. House of Leaves  :

         https://en.wikipedia.org/wiki/House_of_Leaves

     70. Kadokawa Daiei Studio  :

         https://en.wikipedia.org/wiki/Kadokawa_Daiei_Studio

     71. Legend of the Galactic Heroes  :

         https://en.wikipedia.org/wiki/Legend_of_the_Galactic_Heroes

     72. List of Legend of the Galactic Heroes episodes  :

         https://en.wikipedia.org/wiki/List_of_Legend_of_the_Galactic_Heroes_episodes

     73. Original video animation

     74. Worldbuilding

     75. Defeat in detail  :

         https://en.wikipedia.org/wiki/Defeat_in_detail

     76. Frederick the Great

     77. Seven Years' War § Europe  :

         https://en.wikipedia.org/wiki/Seven_Years%27_War#Europe

     78. Interior lines  :

         https://en.wikipedia.org/wiki/Interior_lines

     79. The Rose of Versailles  :

         https://en.wikipedia.org/wiki/The_Rose_of_Versailles

     80. Enlightened absolutism  :

         https://en.wikipedia.org/wiki/Enlightened_absolutism

     81. Space opera  :

         https://en.wikipedia.org/wiki/Space_opera

     82. Honorverse

     83. Belisarius  :

         https://en.wikipedia.org/wiki/Belisarius

     84. Slide projector  :

         https://en.wikipedia.org/wiki/Slide_projector