“Part 1: AI That Writes—GPT-3: a Big Step Forward”, 2022-01-27 (; similar):
…You can get a feel for the incredible performance of GPT-3 in a recent episode of the Clearer Thinking podcast, where we “interviewed” GPT-3. The AI performed surprisingly well as a podcast guest, discussing big topics like the meaning of life, free will, and AI itself. We even had it pretend to be different people, such as the philosopher Peter Singer, and the musician Kanye West.
To demonstrate GPT-3’s capabilities, we got it to generate a poem in the style of Edgar Allan Poe. Below is the prompt we put into GPT-3, so that it would generate plausible text that might come next:
An unpublished poem by Edgar Allan Poe was recently discovered. Some scholars are saying it may be even better than his other work. Here is the Edgar Allan Poe poem, in full: The Whisperer
And here is the poem that GPT-3 generated as a result, on its first try, with no human help:
Upon the pallid bust of Pallas
Aye, Pallas, thou art there!
I see thee sit, serene and still,
As thou wert wont of yore.
The rock-born goddess, from her seat
In the far-off Achaian land,
Thou watch’st the storm-tossed ships
That plough the dark blue sea.
And ever, when the tempest rages,
And the loud waves are breaking,
Thou listen’st to the whispered voice
Of him who calleth thee.
Thee, too, I call, O Pallas!
From thy high seat on Parnassus,
Hearken to my voice, and grant
Thy aid to one who needeth it.The first line of this poem is lifted from “The Raven”, one of the real Edgar Allan Poe’s poems, but the rest of it seems to us to be original sentence constructions. While the above example was produced on its first try, and GPT-3 certainly can produce incredibly impressive output, it often will also produce duds—incongruous language, nonsense, or misinterpretations of your intent. So it’s important to keep in mind that for real-world applications you may need to try a few times to get a reasonable result. Of course, as these models continue to improve, we should expect their reliability to go up. [cf. InstructGPT]