I'm confused why GPT-4 (chat) is so bad at not rhyming in poems. Not only does telling it not to rhyme not stick, but when I try to have it show its work it makes up bizarre justifications. Fascinating!

Mar 16, 2023 · 8:50 AM UTC

17
3
1
87
1
8
The only way I was able to get a poem whose lines didn't match was to ask for a list of words that didn't rhyme first, and then ask for a poem where each word was the end of a line in the poem. Notably, this worked for GPT-4 chat but not GPT-3.5 chat
1
13
Replying to @JeffLadish
asking for "free verse" seems to work
1
17
Ooh thanks!
1
2
more replies
Replying to @JeffLadish
The reason GPT4 can’t write rhymes is aggressive BPE
1
But it can write rhymes!
1
more replies
Replying to @JeffLadish
I wonder if they aggressively RLHFed it towards rhyming, to counteract the BPE issues, or something like that.
2
Replying to @JeffLadish
Isn't the simplest explanation that (1) the poems that it's trained on usually rhyme and (2) its just doesn't have a globally consistent idea of what it's doing?
1
3
Replying to @JeffLadish
This is such a weird failure mode.
1
Replying to @JeffLadish
this is the same in 3.5. You can tell it not to rhyme but if you say poem it still does.
Load more