It just one-shotted the entire Stripe programming interview, which I know for sure isn't in the training data
im thinking about code interpreter being released as a watershed event. if this is not a world changing gdp shifting product im not sure what exactly will be. every person with a script kiddie in their employ for $20/month

Jul 8, 2023 · 11:55 PM UTC

I have muted this because 80% of the replies are stupid
There are other parts of the interview I think it would struggle with, but the pure programming exercise it nails
Replying to @VivaLaPanda_
Without seeing the interview questions I'm not sure if this says more about code interpreter or about Stripe.
The later stages of this question screen >75% of the people I interviewed
Replying to @VivaLaPanda_
I assume it's just a leetcode style problem? Those are the best possible use case for LLMs to solve because the perfect solution is available in some form on the internet already. There are only so many ways to disguise DFS or whatever, the hard part is recognizing it
Don't want to leak the problem, but it's a bit weirder than most leetcodes. But yeah, still basically LLM friendly
Replying to @VivaLaPanda_
Clearly it was trained on OF?
Replying to @VivaLaPanda_
Whoa 🤯