The structure of the token space for large language models
OpenAI begins training next AI model as it battles safety concerns: Executive appears to backtrack on start-up’s vision of building ‘superintelligence’ after exits from ‘Superalignment’ team
VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?
How Tech Giants Cut Corners to Harvest Data for AI: OpenAI, Google and Meta ignored corporate policies, altered their own rules and discussed skirting copyright law as they sought online information to train their newest artificial intelligence systems
Hal-Eval: A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models
The carbon emissions of writing and illustrating are lower for AI than for humans
Altman says ChatGPT will have to evolve in ‘uncomfortable’ ways
RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculture
Gemini vs GPT-4-V: A Preliminary Comparison and Combination of Vision-Language Models Through Qualitative Cases
ByteDance is secretly using OpenAI’s tech to build a competitor
Did I get Sam Altman fired from OpenAI?: Nathan’s red-teaming experience, noticing how the board was not aware of GPT-4 jailbreaks & had not even tried GPT-4 prior to its early release
Inside the Chaos at OpenAI: Sam Altman’s weekend of shock and drama began a year ago, with the release of ChatGPT
Instruction-Following Evaluation for Large Language Models
Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation
Holistic Analysis of Hallucination in GPT-4-V(ision): Bias and Interference Challenges
Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulation
The Generative AI Paradox: "What It Can Create, It May Not Understand"
Interpreting Learned Feedback Patterns in Large Language Models
PAIR: Jailbreaking Black Box Large Language Models in 20 Queries
The Dawn of LMMs: Preliminary Explorations with GPT-4-V(ision)
Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanations
Large Language Models as Superpositions of Cultural Perspectives
Large Language Models Understand and Can be Enhanced by Emotional Stimuli
AI Is a Lot of Work: As the technology becomes ubiquitous, a vast tasker underclass is emerging—and not going anywhere
LTX by Broadridge Launches BondGPT™ Powered by OpenAI GPT-4
Tree of Thoughts (ToT): Deliberate Problem Solving with Large Language Models
Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4
What’s AGI, and Why Are AI Experts Skeptical? ChatGPT and other bots have revived conversations on artificial general intelligence. Scientists say algorithms won’t surpass you any time soon
ChemCrow: Augmenting large-language models with chemistry tools
Sam Altman on What Makes Him ‘Super Nervous’ About AI: The OpenAI co-founder thinks tools like GPT-4 will be revolutionary. But he’s wary of downsides
GPT-4 is coming next week—and it will be multimodal, says Microsoft Germany
As AI Booms, Lawmakers Struggle to Understand the Technology: Tech innovations are again racing ahead of Washington’s ability to regulate them, lawmakers and AI experts said
Allen & Overy breaks the internet (and new ground) with co-pilot Harvey
Context on the NVIDIA ChatGPT opportunity—and ramifications of large language model enthusiasm
New Bing, and an Interview with Kevin Scott and Sam Altman About the Microsoft-OpenAI Partnership
How ChatGPT Kicked Off an AI Arms Race: Even inside the company, the chatbot’s popularity has come as something of a shock
Connor Leahy on Aliens, Ethics, Economics, Memetics, and Education § GPT-4
OpenAI CEO Sam Altman on GPT-4: ‘people are begging to be disappointed and they will be’
Microsoft Bets Big on the Creator of ChatGPT in Race to Dominate AI: As a new chatbot wows the world with its conversational talents, a resurgent tech giant is poised to reap the benefits while doubling down on a relationship with the start-up OpenAI
What to Expect When You’re Expecting…GPT-4. What comes after ChatGPT? 7 predictions for 2023 § GPT-4
Here’s What I Saw at an AI Hackathon: AI gossip, celebrity sightings, tech trends—and some great projects
6 New Theories About AI: Software with superpowers § GPT-4
Have talked to several people who have used GPT-4, they all say it is uncanny how good it is
GPT-4 Rumors From Silicon Valley: People are saying things…
Stack more layers is fine as GPT-4 is about to show but there are superior routes…
Chinchilla: Training Compute-Optimal Large Language Models
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
An Analysis of AI Political Preferences from a European Perspective
https://github.com/spdustin/ChatGPT-AutoExpert/blob/main/System%20Prompts.md
https://manifold.markets/group/gary-marcus-gpt4-predictions
https://newsletter.pragmaticengineer.com/p/scaling-chatgpt#%C2%A7five-scaling-challenges
de8235663546200800f6174df20b20cb9e48f951.html#%C2%A7five-scaling-challenges
https://nostalgebraist.tumblr.com/post/705192637617127424/gpt-4-prediction-it-wont-be-very-useful
https://old.reddit.com/r/slatestarcodex/comments/1201v68/10word_quote_a_short_and_simple_failure_mode_of/jdjsx43/
https://openai.com/blog/new-models-and-developer-products-announced-at-devday
https://simonwillison.net/2023/Oct/14/multi-modal-prompt-injection/
https://terrytao.wordpress.com/2023/06/19/ai-anthology/#comment-678803
32ca743b892d3fff281c955b26ff70ff86cecd85.html#comment-678803
https://www.lesswrong.com/posts/DaaFce3hBoEzYhdvz/how-well-did-manifold-predict-gpt-4
https://www.lesswrong.com/posts/nxhXTfsAf2LTg4xvt/artefacts-generated-by-mode-collapse-in-gpt-4-turbo-serve-as
https://www.lesswrong.com/posts/qdStMFDMrWAnTqNWL/gpt-4-predictions
https://www.lesswrong.com/posts/sY3a4Rfa48CgteBEm/chatgpt-can-learn-indirect-control
https://www.lesswrong.com/posts/t9qvdjY5385MbzoYp/chatgpt-4-solved-all-the-gotcha-problems-i-posed-that
https://www.lesswrong.com/posts/t9svvNPNmFf5Qa3TA/mysteries-of-mode-collapse#pfHTedu4GKaWoxD5K
https://www.lesswrong.com/posts/tbJdxJMAiehewGpq2/impressions-from-base-gpt-4
https://www.lesswrong.com/posts/tt7WtqiEyEiLmAecZ/what-will-gpt-4-be-incapable-of
https://www.linkedin.com/pulse/building-new-bing-jordi-ribas/
https://www.metaculus.com/questions/14305/when-will-gpt-4-be-announced/
https://www.reddit.com/r/singularity/comments/1dmap17/possible_timelines_for_gpt45_and_gpt5/
https://www.reddit.com/r/slatestarcodex/comments/1201v68/10word_quote_a_short_and_simple_failure_mode_of/jdjsx43/
https://www.wired.com/story/cerebras-chip-cluster-neural-networks-ai/
The structure of the token space for large language models
VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?
How Tech Giants Cut Corners to Harvest Data for AI: OpenAI, Google and Meta ignored corporate policies, altered their own rules and discussed skirting copyright law as they sought online information to train their newest artificial intelligence systems
https%253A%252F%252Fwww.nytimes.com%252F2024%252F04%252F06%252Ftechnology%252Ftech-giants-harvest-data-artificial-intelligence.html.html
The carbon emissions of writing and illustrating are lower for AI than for humans
https%253A%252F%252Fwww.nature.com%252Farticles%252Fs41598-024-54271-x.html
RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculture
https%253A%252F%252Farxiv.org%252Fabs%252F2401.08406%2523microsoft.html
Gemini vs GPT-4-V: A Preliminary Comparison and Combination of Vision-Language Models Through Qualitative Cases
Did I get Sam Altman fired from OpenAI?: Nathan’s red-teaming experience, noticing how the board was not aware of GPT-4 jailbreaks & had not even tried GPT-4 prior to its early release
https%253A%252F%252Fcognitiverevolution.substack.com%252Fp%252Fdid-i-get-sam-altman-fired-from-openai.html
Inside the Chaos at OpenAI: Sam Altman’s weekend of shock and drama began a year ago, with the release of ChatGPT
https%253A%252F%252Fwww.theatlantic.com%252Ftechnology%252Farchive%252F2023%252F11%252Fsam-altman-open-ai-chatgpt-chaos%252F676050%252F.html
Holistic Analysis of Hallucination in GPT-4-V(ision): Bias and Interference Challenges
PAIR: Jailbreaking Black Box Large Language Models in 20 Queries
The Dawn of LMMs: Preliminary Explorations with GPT-4-V(ision)
https%253A%252F%252F152334h.github.io%252Fblog%252Fnon-determinism-in-gpt-4%252F.html
Large Language Models as Superpositions of Cultural Perspectives
Large Language Models Understand and Can be Enhanced by Emotional Stimuli
https%253A%252F%252Farxiv.org%252Fabs%252F2307.11760%2523microsoft.html
AI Is a Lot of Work: As the technology becomes ubiquitous, a vast tasker underclass is emerging—and not going anywhere
https%253A%252F%252Fwww.theverge.com%252Ffeatures%252F23764584%252Fai-artificial-intelligence-data-notation-labor-scale-surge-remotasks-openai-chatbots.html
https%253A%252F%252Fwww.theinformation.com%252Farticles%252Fwhy-youtube-could-give-google-an-edge-in-ai.html
Tree of Thoughts (ToT): Deliberate Problem Solving with Large Language Models
https%253A%252F%252Farxiv.org%252Fabs%252F2305.10601%2523deepmind.html
What’s AGI, and Why Are AI Experts Skeptical? ChatGPT and other bots have revived conversations on artificial general intelligence. Scientists say algorithms won’t surpass you any time soon
https%253A%252F%252Fwww.wired.com%252Fstory%252Fwhat-is-artificial-general-intelligence-agi-explained%252F.html
https%253A%252F%252Fblogs.microsoft.com%252Fblog%252F2023%252F03%252F16%252Fintroducing-microsoft-365-copilot-your-copilot-for-work%252F.html
Sam Altman on What Makes Him ‘Super Nervous’ About AI: The OpenAI co-founder thinks tools like GPT-4 will be revolutionary. But he’s wary of downsides
https%253A%252F%252Fnymag.com%252Fintelligencer%252F2023%252F03%252Fon-with-kara-swisher-sam-altman-on-the-ai-revolution.html.html
GPT-4 is coming next week—and it will be multimodal, says Microsoft Germany
https%253A%252F%252Fwww.heise.de%252Fnews%252FGPT-4-is-coming-next-week-and-it-will-be-multimodal-says-Microsoft-Germany-7540972.html.html
As AI Booms, Lawmakers Struggle to Understand the Technology: Tech innovations are again racing ahead of Washington’s ability to regulate them, lawmakers and AI experts said
https%253A%252F%252Fwww.nytimes.com%252F2023%252F03%252F03%252Ftechnology%252Fartificial-intelligence-regulation-congress.html.html
Allen & Overy breaks the internet (and new ground) with co-pilot Harvey
https%253A%252F%252Flegaltechnology.com%252F2023%252F02%252F16%252Fallen-overy-breaks-the-internet-and-new-ground-with-co-pilot-harvey%252F.html
Context on the NVIDIA ChatGPT opportunity—and ramifications of large language model enthusiasm
https%253A%252F%252Fx.com%252Fdavidtayar5%252Fstatus%252F1627690520456691712.html
New Bing, and an Interview with Kevin Scott and Sam Altman About the Microsoft-OpenAI Partnership
https%253A%252F%252Fstratechery.com%252F2023%252Fnew-bing-and-an-interview-with-kevin-scott-and-sam-altman-about-the-microsoft-openai-partnership%252F.html
How ChatGPT Kicked Off an AI Arms Race: Even inside the company, the chatbot’s popularity has come as something of a shock
https%253A%252F%252Fwww.nytimes.com%252F2023%252F02%252F03%252Ftechnology%252Fchatgpt-openai-artificial-intelligence.html.html
OpenAI CEO Sam Altman on GPT-4: ‘people are begging to be disappointed and they will be’
https%253A%252F%252Fwww.theverge.com%252F23560328%252Fopenai-gpt-4-rumor-release-date-sam-altman-interview.html
Microsoft Bets Big on the Creator of ChatGPT in Race to Dominate AI: As a new chatbot wows the world with its conversational talents, a resurgent tech giant is poised to reap the benefits while doubling down on a relationship with the start-up OpenAI
https%253A%252F%252Fwww.nytimes.com%252F2023%252F01%252F12%252Ftechnology%252Fmicrosoft-openai-chatgpt.html.html
What to Expect When You’re Expecting…GPT-4. What comes after ChatGPT? 7 predictions for 2023 § GPT-4
https%253A%252F%252Fgarymarcus.substack.com%252Fp%252Fwhat-to-expect-when-youre-expecting.html
Here’s What I Saw at an AI Hackathon: AI gossip, celebrity sightings, tech trends—and some great projects
https%253A%252F%252Fevery.to%252Fchain-of-thought%252Fthe-knee-of-the-exponential-curve.html
GPT-4 Rumors From Silicon Valley: People are saying things…
https%253A%252F%252Fwww.thealgorithmicbridge.com%252Fp%252Fgpt-4-rumors-from-silicon-valley.html
Stack more layers is fine as GPT-4 is about to show but there are superior routes…
https%253A%252F%252Fx.com%252FEMostaque%252Fstatus%252F1563715319566409729.html
Chinchilla: Training Compute-Optimal Large Language Models
https%253A%252F%252Farxiv.org%252Fabs%252F2203.15556%2523deepmind.html
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
https%253A%252F%252Farxiv.org%252Fabs%252F2203.03466%2523microsoft.html
https%253A%252F%252Farxiv.org%252Fabs%252F2111.12763%2523google.html
Wikipedia Bibliography: