“GPT-3 Creative Fiction § Prompted Rhymes”, Gwern2020-06-19 (, , , , )⁠:

Creative writing by OpenAI’s GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.

Can we cope with GPT-3’s poor rhyming by using a poem format which explicitly lists rhymes before the rhyming line in order to control rhymes, sample from what GPT-3 thinks are valid rhymes, and enable GPT-3 to ‘plan’ lines? No. The predicted rhymes are low-quality, and it doesn’t do a good job when a target is specified either.