ChatGPT-4 suddenly got very good again for some reason, after being unreliable & a little "dull" for weeks (Though this might be my favorite interaction: I asked it to create files for me, it insisted it could not, I told it to try, it did, and then look at the top code comment)

Dec 17, 2023 · 1:29 AM UTC

109
211
40
2,499
Really, really good. And fast. Hmmmm....
5
3
223
Its almost like working with a more capable system. Night and day, for both speed and answer quality.
17
6
3
299
Some replies to the post are saying that their version of ChatGPT Plus is reporting that it is GPT-4.5. Not seeing any sign of that myself. (Also, the system does not feel like a step change in abilities so far. Faster and better quality responses, yes, but not a radical shift)
19
4
4
131
And I should note that it is not always useful to ask the AI about itself, it has relatively little “self-knowledge.” You get a lot of hallucinations that way. That makes it hard to confirm or deny any modifications to the underlying model without official announcements.
4
3
109
See what I mean?
13
1
1
105
Anyhow, AI is hard to measure as there are no real objective tests that hold up for benchmarking a system’s “general intelligence.” The AI can always have cheated (it was in training data) or a better prompt could have let it do more. In the end, it sort of comes down to vibes
3
8
60