See Also

Miscellaneous

• https://github.com/spdustin/ChatGPT-AutoExpert/blob/main/System%20Prompts.md

• https://manifold.markets/group/gary-marcus-gpt4-predictions

• https://newsletter.pragmaticengineer.com/p/scaling-chatgpt#%C2%A7five-scaling-challenges

• https://nostalgebraist.tumblr.com/post/705192637617127424/gpt-4-prediction-it-wont-be-very-useful⁠:

  View HTML:

  /doc/www/nostalgebraist.tumblr.com/33bdfb73406c43a5ac2ec54928b0fcfe0f722654.html

• https://old.reddit.com/r/slatestarcodex/comments/1201v68/10word_quote_a_short_and_simple_failure_mode_of/jdjsx43/

• https://openai.com/blog/new-models-and-developer-products-announced-at-devday

• https://openai.com/form/researcher-access-program

• https://openai.com/pricing#fine-tuning-models

• https://passaglia.jp/gpt-japanese/

• https://platform.openai.com/docs/guides/vision

• https://simonwillison.net/2023/Oct/14/multi-modal-prompt-injection/

• https://terrytao.wordpress.com/2023/06/19/ai-anthology/#comment-678803

• https://twitter.com/ChengleiSi/status/1731047065382523332⁠:

  /doc/www/localhost/7f45b87c1038479b4ff908e94f4545464cdd3184.html

• https://twitter.com/ID_AA_Carmack/status/1636043611266490368

• https://twitter.com/LouisKnightWebb/status/1724510794514157668

• https://twitter.com/MatthewJBar/status/1605328892926885888⁠:

  /doc/www/localhost/ef2080374cc0f90e732fe8125187486a0ff323f4.html

• https://twitter.com/OfficialLoganK/status/1663934947931897857⁠:

  /doc/www/localhost/e52c6c4f9055f36960d6beeec7693ac845532e11.html

• https://twitter.com/OpenAIDevs/status/1779922566091522492⁠:

  https://twitter.com/OpenAIDevs/status/1779922566091522492

• https://twitter.com/agikoala/status/1695125016764157988⁠:

  /doc/www/localhost/4d3c875a828a2407a71599ef0fb129be2ee2d01c.html

• https://twitter.com/agishibaa/status/1770206746960601583

• https://twitter.com/charliebholtz/status/1724815159590293764

• https://twitter.com/deepfates/status/1682110624271319040

• https://twitter.com/elder_plinius/status/1778188202664169724

• https://twitter.com/emollick/status/1658698874117308417

• https://twitter.com/fortelabs/status/1734284384537333813⁠:

  /doc/www/localhost/3f7111cb5e915441dfab993fab215fac8730eceb.html

• https://twitter.com/gdb/status/1609244547460255744

• https://twitter.com/javilopen/status/1719363669685916095

• https://twitter.com/john__allard/status/1748140402912481537

• https://twitter.com/matthewjbar/status/1605509829555953667⁠:

  /doc/www/localhost/d73a5f8d34bc4f3bf96f427c0bfd24f90916a02f.html

• https://twitter.com/npew/status/1706356566629421429⁠:

  /doc/www/localhost/c46568b61312a61f21487bc50aec423fa9c86d17.html

• https://twitter.com/polynoamial/status/1676971503261454340

• https://twitter.com/repligate/status/1767002880987283801

• https://twitter.com/soumithchintala/status/1671267150101721090

• https://twitter.com/swyx/status/1722441535235768372

• https://twitter.com/transitive_bs/status/1628118163874516992

• https://twitter.com/venturetwins/status/1710321733184667985

• https://twitter.com/voooooogel/status/1730726744314069190⁠:

  /doc/www/localhost/7318c26409457516faf61216e1c2dbd7a89eebfd.html

• https://www.lesswrong.com/posts/DaaFce3hBoEzYhdvz/how-well-did-manifold-predict-gpt-4⁠:

  View External Link:

  https://www.lesswrong.com/posts/DaaFce3hBoEzYhdvz/how-well-did-manifold-predict-gpt-4

• https://www.lesswrong.com/posts/nxhXTfsAf2LTg4xvt/artefacts-generated-by-mode-collapse-in-gpt-4-turbo-serve-as

• https://www.lesswrong.com/posts/qdStMFDMrWAnTqNWL/gpt-4-predictions

• https://www.lesswrong.com/posts/sY3a4Rfa48CgteBEm/chatgpt-can-learn-indirect-control

• https://www.lesswrong.com/posts/t9qvdjY5385MbzoYp/chatgpt-4-solved-all-the-gotcha-problems-i-posed-that

• https://www.lesswrong.com/posts/t9svvNPNmFf5Qa3TA/mysteries-of-mode-collapse?commentId=pfHTedu4GKaWoxD5K

• https://www.lesswrong.com/posts/tbJdxJMAiehewGpq2/impressions-from-base-gpt-4

• https://www.lesswrong.com/posts/tt7WtqiEyEiLmAecZ/what-will-gpt-4-be-incapable-of⁠:

  View External Link:

  https://www.lesswrong.com/posts/tt7WtqiEyEiLmAecZ/what-will-gpt-4-be-incapable-of

• https://www.linkedin.com/pulse/building-new-bing-jordi-ribas/

• https://www.metaculus.com/questions/14305/when-will-gpt-4-be-announced/

• https://www.reddit.com/r/slatestarcodex/comments/1201v68/10word_quote_a_short_and_simple_failure_mode_of/jdjsx43/

• https://www.theverge.com/2023/2/23/23609942/microsoft-bing-sydney-chatbot-history-ai

• https://www.wired.com/story/cerebras-chip-cluster-neural-networks-ai/⁠:

  View HTML:

  /doc/www/www.wired.com/06063937ace16bab7939d7f5b6ee254246ddf507.html

• https://www.youtube.com/watch?v=U9mJuUkhUzk

Link Bibliography

1. https://www.nytimes.com/2024/04/06/technology/tech-giants-harvest-data-artificial-intelligence.html: “How Tech Giants Cut Corners to Harvest Data for AI: OpenAI, Google and Meta Ignored Corporate Policies, Altered Their Own Rules and Discussed Skirting Copyright Law As They Sought Online Information to Train Their Newest Artificial Intelligence Systems”, Cade Metz, Cecilia Kang, Sheera Frenkel, Stuart A. Thompson, Nico Grant

   link-bibliography

2. https://arxiv.org/abs/2401.08406#microsoft: “RAG vs Fine-Tuning: Pipelines, Tradeoffs, and a Case Study on Agriculture”, Angels Balaguer, Vinamra Benara, Renato Luiz de Freitas Cunha, Roberto de M. Estevão Filho, Todd Hendry

   link-bibliography

3. https://arxiv.org/abs/2312.15011: “Gemini vs GPT-4-V: A Preliminary Comparison and Combination of Vision-Language Models Through Qualitative Cases”, Zhangyang Qi, Ye Fang, Mengchen Zhang, Zeyi Sun, Tong Wu, Ziwei Liu, Dahua Lin, Jiaqi Wang, Hengshuang Zhao

   link-bibliography

4. https://www.newyorker.com/magazine/2023/12/11/the-inside-story-of-microsofts-partnership-with-openai: “The Inside Story of Microsoft’s Partnership With OpenAI: The Companies Had Honed a Protocol for Releasing Artificial Intelligence Ambitiously but Safely. Then OpenAI’s Board Exploded All Their Carefully Laid Plans”, Charles Duhigg

   link-bibliography

5. https://cognitiverevolution.substack.com/p/did-i-get-sam-altman-fired-from-openai: “Did I Get Sam Altman Fired from OpenAI?: Nathan’s Redteaming Experience, Noticing How the Board Was Not Aware of GPT-4 Jailbreaks & Had Not Even Tried GPT-4 prior to Its Early Release”, Nathan Labenz

   link-bibliography

6. https://www.theatlantic.com/technology/archive/2023/11/sam-altman-open-ai-chatgpt-chaos/676050/: “Inside the Chaos at OpenAI: Sam Altman’s Weekend of Shock and Drama Began a Year Ago, With the Release of ChatGPT”, Karen Hao, Charlie Warzel

   link-bibliography

7. https://arxiv.org/abs/2311.03287: “Holistic Analysis of Hallucination in GPT-4-V(ision): Bias and Interference Challenges”, Chenhang Cui, Yiyang Zhou, Xinyu Yang, Shirley Wu, Linjun Zhang, James Zou, Huaxiu Yao

   link-bibliography

8. https://arxiv.org/abs/2310.08419: “PAIR: Jailbreaking Black Box Large Language Models in 20 Queries”, Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, Eric Wong

   link-bibliography

9. https://arxiv.org/abs/2309.17421: “The Dawn of LMMs: Preliminary Explorations With GPT-4-V(ision)”, Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, Lijuan Wang

   link-bibliography

10. https://152334h.github.io/blog/non-determinism-in-gpt-4/: “Non-Determinism in GPT-4 Is Caused by Sparse MoE”, ​152334H

    link-bibliography

11. https://arxiv.org/abs/2307.07870: “Large Language Models As Superpositions of Cultural Perspectives”, Grgur Kovač, Masataka Sawayama, Rémy Portelas, Cédric Colas, Peter Ford Dominey, Pierre-Yves Oudeyer

    link-bibliography

12. https://arxiv.org/abs/2307.11760#microsoft: “Large Language Models Understand and Can Be Enhanced by Emotional Stimuli”, Cheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu, Wenxin Hou, Jianxun Lian, Fang Luo, Qiang Yang, Xing Xie

    link-bibliography

13. https://www.theverge.com/features/23764584/ai-artificial-intelligence-data-notation-labor-scale-surge-remotasks-openai-chatbots: “AI Is a Lot of Work: As the Technology Becomes Ubiquitous, a Vast Tasker Underclass Is Emerging—And Not Going Anywhere”, Josh Dzieza

    link-bibliography

14. https://www.theinformation.com/articles/why-youtube-could-give-google-an-edge-in-ai: “Why YouTube Could Give Google an Edge in AI”, Jon Victor

    link-bibliography

15. https://www.wsj.com/articles/microsoft-and-openai-forge-awkward-partnership-as-techs-new-power-couple-3092de51: “Microsoft and OpenAI Forge Awkward Partnership As Tech’s New Power Couple: As the Companies Lead the AI Boom, Their Unconventional Arrangement Sometimes Causes Conflict”, Tom Dotan, Deepa Seetharaman

    link-bibliography

16. https://arxiv.org/abs/2305.10601#deepmind: “Tree of Thoughts (ToT): Deliberate Problem Solving With Large Language Models”, Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan

    link-bibliography

17. https://www.wired.com/story/what-is-artificial-general-intelligence-agi-explained/: “What’s AGI, and Why Are AI Experts Skeptical? ChatGPT and Other Bots Have Revived Conversations on Artificial General Intelligence. Scientists Say Algorithms Won’t Surpass You Any Time Soon”, Reece Rogers

    link-bibliography

18. https://blogs.microsoft.com/blog/2023/03/16/introducing-microsoft-365-copilot-your-copilot-for-work/: “Introducing Microsoft 365 Copilot—Your Copilot for Work”, Jared Spataro

    link-bibliography

19. https://nymag.com/intelligencer/2023/03/on-with-kara-swisher-sam-altman-on-the-ai-revolution.html: “Sam Altman on What Makes Him ‘Super Nervous’ About AI: The OpenAI Co-Founder Thinks Tools like GPT-4 Will Be Revolutionary. But He’s Wary of Downsides”, Kara Swisher

    link-bibliography

20. https://www.heise.de/news/GPT-4-is-coming-next-week-and-it-will-be-multimodal-says-Microsoft-Germany-7540972.html: “GPT-4 Is Coming next Week—And It Will Be Multimodal, Says Microsoft Germany”, Silke Hahn

    link-bibliography

21. https://www.nytimes.com/2023/03/03/technology/artificial-intelligence-regulation-congress.html: “As AI Booms, Lawmakers Struggle to Understand the Technology: Tech Innovations Are Again Racing ahead of Washington’s Ability to Regulate Them, Lawmakers and AI Experts Said”, Cecila Kang, Adam Satariano

    link-bibliography

22. https://legaltechnology.com/2023/02/16/allen-overy-breaks-the-internet-and-new-ground-with-co-pilot-harvey/: “Allen & Overy Breaks the Internet (and New Ground) With Co-Pilot Harvey”, Caroline Hill

    link-bibliography

23. https://twitter.com/davidtayar5/status/1627690520456691712: “Context on the NVIDIA ChatGPT Opportunity—And Ramifications of Large Language Model Enthusiasm”, Morgan Stanley

    link-bibliography

24. https://stratechery.com/2023/new-bing-and-an-interview-with-kevin-scott-and-sam-altman-about-the-microsoft-openai-partnership/: “New Bing, and an Interview With Kevin Scott and Sam Altman About the Microsoft-OpenAI Partnership”, Ben Thompson

    link-bibliography

25. https://www.theverge.com/23589994/microsoft-ceo-satya-nadella-bing-chatgpt-google-search-ai: “Microsoft Thinks AI Can Beat Google at Search—CEO Satya Nadella Explains Why: AI Is Coming for Your Browser, Your Social Media, and Your Operating System, Too”, Nilay Patel

    link-bibliography

26. https://www.nytimes.com/2023/02/03/technology/chatgpt-openai-artificial-intelligence.html: “How ChatGPT Kicked Off an AI Arms Race: Even inside the Company, the Chatbot’s Popularity Has Come As Something of a Shock”, Kevin Roose

    link-bibliography

27. https://www.theverge.com/23560328/openai-gpt-4-rumor-release-date-sam-altman-interview: “OpenAI CEO Sam Altman on GPT-4: ‘People Are Begging to Be Disappointed and They Will Be’”, James Vincent

    link-bibliography

28. https://www.nytimes.com/2023/01/12/technology/microsoft-openai-chatgpt.html: “Microsoft Bets Big on the Creator of ChatGPT in Race to Dominate AI: As a New Chatbot Wows the World With Its Conversational Talents, a Resurgent Tech Giant Is Poised to Reap the Benefits While Doubling down on a Relationship With the Start-Up OpenAI”, Cade Metz, Karen Weise

    link-bibliography

29. https://garymarcus.substack.com/p/what-to-expect-when-youre-expecting: “What to Expect When You’re Expecting…GPT-4. What Comes After ChatGPT? 7 Predictions for 2023 § GPT-4”, Gary Marcus

    link-bibliography

30. https://every.to/chain-of-thought/the-knee-of-the-exponential-curve: “Here’s What I Saw at an AI Hackathon: AI Gossip, Celebrity Sightings, Tech Trends—And Some Great Projects”, Dan Shipper

    link-bibliography

31. https://thealgorithmicbridge.substack.com/p/gpt-4-rumors-from-silicon-valley: “GPT-4 Rumors From Silicon Valley: People Are Saying Things…”, Alberto Romero

    link-bibliography

32. https://twitter.com/EMostaque/status/1563715319566409729: “Stack More Layers Is Fine As GPT-4 Is about to Show but There Are Superior Routes…”, Emad Mostaque

    link-bibliography

33. https://arxiv.org/abs/2203.15556#deepmind: “Chinchilla: Training Compute-Optimal Large Language Models”, Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas

    link-bibliography

34. https://arxiv.org/abs/2203.03466#microsoft: “Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer”, Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, Xiaodong Liu, David Farhi, Nick Ryder, Jakub Pachocki

    link-bibliography

35. https://arxiv.org/abs/2111.12763#google: “Sparse Is Enough in Scaling Transformers”, Sebastian Jaszczur, Aakanksha Chowdhery, Afroz Mohiuddin, Łukasz Kaiser, Wojciech Gajewski, Henryk Michalewski

    link-bibliography