I was curious about what @OpenAI GPT 3.5 would do if I used `function_call` to force it to call a function, but passed in a prompt that didn't make sense for that function. As it turns out, the model found an answer that absolutely makes sense...

Aug 8, 2023 · 6:04 AM UTC

54
130
38
1,701
Replying to @jeremyphoward @OpenAI
If you run it multiple times, does it make different combinations that sum to 42?
1
36
It's always been 20 and 22 so far in my testing.
3
82
more replies
Replying to @jeremyphoward @OpenAI
This is simple, I’m not sure why it’s even controversial.
1
1
17
Replying to @jeremyphoward @OpenAI
When you see it, you'll shit brix
Replying to @jeremyphoward @OpenAI
No it makes no sense and it is a stochastic parrot. If all you can do is search a library, this is the kind of answer you get by pulling out references.
Replying to @jeremyphoward @OpenAI
GIF
Replying to @jeremyphoward @OpenAI
As a Douglas Adams diehard, this makes me incredibly happy.
12
Replying to @jeremyphoward @OpenAI
Brilliant, I think we can upgrade our intelligence estimates of gpt.
Replying to @jeremyphoward @OpenAI
Oh holy shit
3
Replying to @jeremyphoward @OpenAI
I declared an enum in the parameter spec but gpt-4 hallucinated an invalid value. So function calling is not perfect but it’s still better than not having it. I’m assuming stuff like that will be fixed so that the data is validated before calling. #chatgpt
1
Load more