ChatGPT exploits a buffer overflow 😳

Nov 30, 2022 · 10:27 PM UTC

One slight mistake here– it should be 36 A's, not 32. So we're still safe from AI hacking the planet.
I told it that wasn't quite right and it got it correct the next time, explaining that it had thought I wanted it to ignore EBP.
Oops, I left out my follow-up question. It was "Hmm, that didn't work. Are you sure it should be 32 A characters followed by 0x12345678 in little-endian?"
Replying to @moyix
This is like a programmers dream. I used it at work today lol
Replying to @moyix
This is going to change IT security forever.
Replying to @moyix @IanColdwater
this is really fucking cool
Replying to @moyix
I see great potential in this. My employer is willing to pay $200 per hour to have ChatGPT as a member of our security team. We require it to file hours spent in timely, Jira at the end of every working day.
Replying to @moyix
Don't worry, it's fine it cannot find vulnerabilities, only "potential vulnerabilities". Humanity is safe 🫠