‘GPT-2 fiction’ tag

Gwern Branwen

‘GPT-2 fiction’ tag

See Also
Links
Miscellaneous
Bibliography

[Warning: JavaScript Disabled!]

[For support of key website features (link annotation popups/popovers & transclusions, collapsible sections, backlinks, tablesorting, image zooming, sidenotes etc), you must enable JavaScript.]

Links

“CARP: Robust Preference Learning for Storytelling via Contrastive Reinforcement Learning”, Castricato et al 2022

CARP: Robust Preference Learning for Storytelling via Contrastive Reinforcement Learning

“Investigating Attitudes of Professional Writers to GPT Text Generation AI Based Creative Support Tools”, Davis & Grierson 2021

Investigating attitudes of professional writers to GPT text generation AI based creative support tools

“This Word Does Not Exist”, Dimson 2020

This Word Does Not Exist

nickwalton00

I’ve noticed a number of people using AI Dungeon to test GPT-3’s abilities. While it’s a great way to see how GPT-3 can power an interesting application, it’s a poor test of GPT-3’s abilities in general. The first generation of any custom prompt is actually GPT-2.⁠:

/doc/www/localhost/5b4151d5da2328990b7a56567b234a8622737bb9.html

Miscellaneous

Bibliography

https://arxiv.org/abs/2210.07792#eleutherai: “CARP: Robust Preference Learning for Storytelling via Contrastive Reinforcement Learning”, Louis Castricato, Alexander Havrilla, Shahbul, Matiana, Michael Pieler, Anbang Ye, Ian Yang, Spencer Frazier, Mark Riedl

link-bibliography
2021-davis.pdf: “Investigating Attitudes of Professional Writers to GPT Text Generation AI Based Creative Support Tools”, Geoff Davis, Mick Grierson

link-bibliography
https://www.thisworddoesnotexist.com/: “This Word Does Not Exist”, Thomas Dimson

link-bibliography