“Altman on Scaling”, Jacques Thibs2023-06-06 (GPT-5)⁠:

I spoke to Sam Altman about a month ago. He essentially said some of the following:

• His recent statement about scaling essentially plateau-ing was misunderstood and he still thinks it plays a big role.

• Then, I asked him what comes next and he said they are working on the next thing that will provide 1000× improvement (some new paradigm).

• I asked if online learning plays a role in that and he said yes. [Q^✱?]

• That’s one of the reasons we started to work on “Supervising AIs Improving AIs”.

…As Max H said, I think once you meet a threshold with a universal interface like a language model, things start to open up and the game changes.

See Also:

• Sam Altman accepts the 2023 Hawking Fellowship Award § Is there another breakthrough that’s needed to reach AGI?

• A Theory for Emergence of Complex Skills in Language Models