“GPT-3 Creative Fiction § Dad Jokes”, Gwern2020-06-19 (, , , , )⁠:

Creative writing by OpenAI’s GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.

Douglas Summers-Stay requested a test of bad pun/dad joke-telling abilities, providing a list: could GPT-3 provide humorous completions? GPT-3 does worse on this than the Tom Swifties, I suspect yet again due to the BPE problem hobbling linguistic humor as opposed to conceptual humor—once you get past the issue that these jokes are so timeworn that GPT-3 has memorized most of them, GPT-3’s completions & new jokes make a reasonable amount of sense on the conceptual level but fail at the pun/phonetic level. (How would GPT-3 make a pun on “whom”/“tomb” when their BPEs probably are completely different and do not reflect their phonetic similarity?)