See Also

Miscellaneous

• https://github.com/spdustin/ChatGPT-AutoExpert/blob/main/System%20Prompts.md

• https://manifold.markets/group/gary-marcus-gpt4-predictions

• https://nostalgebraist.tumblr.com/post/705192637617127424/gpt-4-prediction-it-wont-be-very-useful

• https://old.reddit.com/r/slatestarcodex/comments/1201v68/10word_quote_a_short_and_simple_failure_mode_of/jdjsx43/

• https://openai.com/blog/new-models-and-developer-products-announced-at-devday

• https://openai.com/form/researcher-access-program

• https://openai.com/pricing#fine-tuning-models

• https://passaglia.jp/gpt-japanese/

• https://platform.openai.com/docs/guides/vision

• https://simonwillison.net/2023/Oct/14/multi-modal-prompt-injection/

• https://terrytao.wordpress.com/2023/06/19/ai-anthology/#comment-678803

• https://twitter.com/ChengleiSi/status/1731047065382523332

• https://twitter.com/ID_AA_Carmack/status/1636043611266490368

• https://twitter.com/LouisKnightWebb/status/1724510794514157668

• https://twitter.com/MatthewJBar/status/1605328892926885888

• https://twitter.com/OfficialLoganK/status/1663934947931897857

• https://twitter.com/agikoala/status/1695125016764157988

• https://twitter.com/charliebholtz/status/1724815159590293764

• https://twitter.com/deepfates/status/1682110624271319040

• https://twitter.com/emollick/status/1658698874117308417

• https://twitter.com/gdb/status/1609244547460255744

• https://twitter.com/javilopen/status/1719363669685916095

• https://twitter.com/matthewjbar/status/1605509829555953667

• https://twitter.com/npew/status/1706356566629421429

• https://twitter.com/polynoamial/status/1676971503261454340

• https://twitter.com/soumithchintala/status/1671267150101721090

• https://twitter.com/swyx/status/1722441535235768372

• https://twitter.com/transitive_bs/status/1628118163874516992

• https://twitter.com/venturetwins/status/1710321733184667985

• https://twitter.com/voooooogel/status/1730726744314069190

• https://www.lesswrong.com/posts/DaaFce3hBoEzYhdvz/how-well-did-manifold-predict-gpt-4

• https://www.lesswrong.com/posts/nxhXTfsAf2LTg4xvt/artefacts-generated-by-mode-collapse-in-gpt-4-turbo-serve-as

• https://www.lesswrong.com/posts/qdStMFDMrWAnTqNWL/gpt-4-predictions

• https://www.lesswrong.com/posts/t9qvdjY5385MbzoYp/chatgpt-4-solved-all-the-gotcha-problems-i-posed-that

• https://www.lesswrong.com/posts/tbJdxJMAiehewGpq2/impressions-from-base-gpt-4

• https://www.lesswrong.com/posts/tt7WtqiEyEiLmAecZ/what-will-gpt-4-be-incapable-of

• https://www.metaculus.com/questions/14305/when-will-gpt-4-be-announced/

• https://www.reddit.com/r/slatestarcodex/comments/1201v68/10word_quote_a_short_and_simple_failure_mode_of/jdjsx43/

• https://www.wired.com/story/cerebras-chip-cluster-neural-networks-ai/

• https://www.youtube.com/watch?v=U9mJuUkhUzk

Link Bibliography

1. https://www.newyorker.com/magazine/2023/12/11/the-inside-story-of-microsofts-partnership-with-openai: “The Inside Story of Microsoft’s Partnership With OpenAI: The Companies Had Honed a Protocol for Releasing Artificial Intelligence Ambitiously but Safely. Then OpenAI’s Board Exploded All Their Carefully Laid Plans”, Charles Duhigg

   link-bibliography

2. https://cognitiverevolution.substack.com/p/did-i-get-sam-altman-fired-from-openai: “Did I Get Sam Altman Fired from OpenAI?: Nathan’s Redteaming Experience, Noticing How the Board Was Not Aware of GPT-4 Jailbreaks & Had Not Even Tried GPT-4 prior to Its Early Release”, Nathan Labenz

   link-bibliography

3. https://www.theatlantic.com/technology/archive/2023/11/sam-altman-open-ai-chatgpt-chaos/676050/: “Inside the Chaos at OpenAI: Sam Altman’s Weekend of Shock and Drama Began a Year Ago, With the Release of ChatGPT”, Karen Hao, Charlie Warzel

   link-bibliography

4. https://arxiv.org/abs/2307.11760#microsoft: “Large Language Models Understand and Can Be Enhanced by Emotional Stimuli”, Cheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu, Wenxin Hou, Jianxun Lian, Fang Luo, Qiang Yang, Xing Xie

   link-bibliography

5. https://www.theverge.com/features/23764584/ai-artificial-intelligence-data-notation-labor-scale-surge-remotasks-openai-chatbots: “AI Is a Lot of Work: As the Technology Becomes Ubiquitous, a Vast Tasker Underclass Is Emerging—and Not Going Anywhere”, Josh Dzieza

   link-bibliography

6. https://www.theinformation.com/articles/why-youtube-could-give-google-an-edge-in-ai: “Why YouTube Could Give Google an Edge in AI”, Jon Victor

   link-bibliography

7. https://www.wsj.com/articles/microsoft-and-openai-forge-awkward-partnership-as-techs-new-power-couple-3092de51: “Microsoft and OpenAI Forge Awkward Partnership As Tech’s New Power Couple: As the Companies Lead the AI Boom, Their Unconventional Arrangement Sometimes Causes Conflict”, Tom Dotan, Deepa Seetharaman

   link-bibliography

8. https://arxiv.org/abs/2305.10601#deepmind: “Tree of Thoughts (ToT): Deliberate Problem Solving With Large Language Models”, Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan

   link-bibliography

9. https://www.wired.com/story/what-is-artificial-general-intelligence-agi-explained/: “What’s AGI, and Why Are AI Experts Skeptical? ChatGPT and Other Bots Have Revived Conversations on Artificial General Intelligence. Scientists Say Algorithms Won’t Surpass You Any Time Soon”, Reece Rogers

   link-bibliography

10. https://blogs.microsoft.com/blog/2023/03/16/introducing-microsoft-365-copilot-your-copilot-for-work/: “Introducing Microsoft 365 Copilot—your Copilot for Work”, Jared Spataro

    link-bibliography

11. https://nymag.com/intelligencer/2023/03/on-with-kara-swisher-sam-altman-on-the-ai-revolution.html: “Sam Altman on What Makes Him ‘Super Nervous’ About AI: The OpenAI Co-founder Thinks Tools like GPT-4 Will Be Revolutionary. But He’s Wary of Downsides”, Kara Swisher

    link-bibliography

12. https://www.heise.de/news/GPT-4-is-coming-next-week-and-it-will-be-multimodal-says-Microsoft-Germany-7540972.html: “GPT-4 Is Coming next Week—and It Will Be Multimodal, Says Microsoft Germany”, Silke Hahn

    link-bibliography

13. https://www.nytimes.com/2023/03/03/technology/artificial-intelligence-regulation-congress.html: “As A.I. Booms, Lawmakers Struggle to Understand the Technology: Tech Innovations Are Again Racing ahead of Washington’s Ability to Regulate Them, Lawmakers and A.I. Experts Said”, Cecila Kang, Adam Satariano

    link-bibliography

14. https://legaltechnology.com/2023/02/16/allen-overy-breaks-the-internet-and-new-ground-with-co-pilot-harvey/: “Allen & Overy Breaks the Internet (and New Ground) With Co-pilot Harvey”, Caroline Hill

    link-bibliography

15. https://twitter.com/davidtayar5/status/1627690520456691712: “Context on the NVIDIA ChatGPT Opportunity—and Ramifications of Large Language Model Enthusiasm”, Morgan Stanley

    link-bibliography

16. https://stratechery.com/2023/new-bing-and-an-interview-with-kevin-scott-and-sam-altman-about-the-microsoft-openai-partnership/: “New Bing, and an Interview With Kevin Scott and Sam Altman About the Microsoft-OpenAI Partnership”, Ben Thompson

    link-bibliography

17. https://www.theverge.com/23589994/microsoft-ceo-satya-nadella-bing-chatgpt-google-search-ai: “Microsoft Thinks AI Can Beat Google at Search—CEO Satya Nadella Explains Why: AI Is Coming for Your Browser, Your Social Media, and Your Operating System, Too”, Nilay Patel

    link-bibliography

18. https://www.nytimes.com/2023/02/03/technology/chatgpt-openai-artificial-intelligence.html: “How ChatGPT Kicked Off an A.I. Arms Race: Even inside the Company, the Chatbot’s Popularity Has Come As Something of a Shock”, Kevin Roose

    link-bibliography

19. https://www.theverge.com/23560328/openai-gpt-4-rumor-release-date-sam-altman-interview: “OpenAI CEO Sam Altman on GPT-4: ‘people Are Begging to Be Disappointed and They Will Be’”, James Vincent

    link-bibliography

20. https://www.nytimes.com/2023/01/12/technology/microsoft-openai-chatgpt.html: “Microsoft Bets Big on the Creator of ChatGPT in Race to Dominate A.I.: As a New Chatbot Wows the World With Its Conversational Talents, a Resurgent Tech Giant Is Poised to Reap the Benefits While Doubling down on a Relationship With the Start-up OpenAI”, Cade Metz, Karen Weise

    link-bibliography

21. https://garymarcus.substack.com/p/what-to-expect-when-youre-expecting: “What to Expect When You’re Expecting…GPT-4. What Comes After ChatGPT? 7 Predictions for 2023 § GPT-4”, Gary Marcus

    link-bibliography

22. https://every.to/chain-of-thought/the-knee-of-the-exponential-curve: “Here’s What I Saw at an AI Hackathon: AI Gossip, Celebrity Sightings, Tech Trends—and Some Great Projects”, Dan Shipper

    link-bibliography

23. https://thealgorithmicbridge.substack.com/p/gpt-4-rumors-from-silicon-valley: “GPT-4 Rumors From Silicon Valley: People Are Saying Things...”, Alberto Romero

    link-bibliography

24. https://twitter.com/EMostaque/status/1563715319566409729: “Stack More Layers Is Fine As GPT-4 Is about to Show but There Are Superior Routes…”, Emad Mostaque

    link-bibliography

25. https://arxiv.org/abs/2203.15556#deepmind: “Chinchilla: Training Compute-Optimal Large Language Models”, Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas

    link-bibliography

26. https://arxiv.org/abs/2203.03466: “Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer”, Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, Xiaodong Liu, David Farhi, Nick Ryder, Jakub Pachocki

    link-bibliography

27. https://openreview.net/forum?id=Bx6qKuBM2AD#microsoft: “Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer”, Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, Xiaodong Liu, David Farhi, Nick Ryder, Jakub Pachocki

    link-bibliography

28. https://arxiv.org/abs/2111.12763#google: “Sparse Is Enough in Scaling Transformers”, Sebastian Jaszczur, Aakanksha Chowdhery, Afroz Mohiuddin, Łukasz Kaiser, Wojciech Gajewski, Henryk Michalewski

    link-bibliography