“GPT-3 Creative Fiction § IPA Rhyme Annotations”, Gwern2020-06-19 (, , , , )⁠:

Creative writing by OpenAI’s GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.

Another idea I had for enabling rhymes was to provide explicit annotations of the phonetics of the rhyme words. If GPT-3 could see the IPA phonetic transcription (the first phonetic scheme that occurred to me to use which would have good tooling), perhaps it could ‘realize’ the sounds of the end rhyme words were similar, and understand what rhyming was. In initial prompt completions, GPT-3 also seemed to have good knowledge of many English word’s IPA form (which I expected because many online dictionaries & Wikipedia include IPA for defined words). Thus, if I annotated appropriately, perhaps GPT-3 could be able to complete the English → IPA → English loop and start fluently rhyming on its own?

I experimented with postfixed IPA versions, English rhyme pair annotations, inline IPA versions, prefixed spaced-separated IPA versions—but nothing doing. Another failure.