I gave GPT-4 the same exam (via ChatGPT+) and it got 93% It can do basic algebra correctly now, which if I remember what it got wrong last time is responsible for 10 percentage points of the increase
Nick HK @nickchk
25 Jan 2023
I gave ChatGPT my upcoming principles of micro midterm and it got 63% (typical actual-student score around 80% or a touch lower)
1
8
49
The questions it missed (1/2 pt on the first, 1 pt on the second, out of 20)
1
1
Of course (thankfully?), it remains fully capable of being confidently wrong on more advanced subjects.
3
4
I gave it my second midterm again as well and it got 95%, from calculating a Nash in a generic simultaneous game incorrectly. It's MUCH better at questions about human deception + lying now. This answer was esp. impressive
Nick HK @nickchk
3 Feb 2023
I gave it my second midterm and it got 68% (again compared to typical student 80% or so)

Mar 14, 2023 · 7:56 PM UTC

2
1
1
4
Realizing that on the first exam there's no partial credit on that first question so it should actually be 90% not 93%. Still quite a jump from just a few months ago.
1
4
Replying to @nickchk
Impressive! Wondering what happens if you ask it to regenerate the answer? Does it change its mind, or does the answer remain correct although formulated differently?
1
Not sure! Could be worth trying. I figure my students only get one shot at it though, so...
1
more replies