Tom Goldstein (@tomgoldsteincs): "But then it CAN do this task." | gwitter

Tom Goldstein @tomgoldsteincs

Here's ChatGPT convos that will be interesting to NLP experts and nobody else. Should this be possible? Think about the tokenizer.

Tom Goldstein @tomgoldsteincs

Here's another task that the tokenizer should make impossible. Fortunately for my sanity, ChatGPT gets it wrong almost always.

Tom Goldstein @tomgoldsteincs

But then it CAN do this task.

Dec 9, 2022 · 7:16 AM UTC

Tom Goldstein @tomgoldsteincs

Weird.

Egemen Pamukçu @EgemenPamukcu

Replying to @tomgoldsteincs

It struggles when you give it a word that has an ending that can sound different in different words though. As you would expect.

Abhas Kumar Shrivastava (Chad)✨🇮🇳 @abhas_rewcie

Replying to @tomgoldsteincs

There are rhyme finding websites. It must have crawled over those for sure. The language transformer might have used character + symbols (incl. spaces) to output each-at-a-time. So it's definitely possible for it to learn alphabet patterns used in rhyme. So no surprises.