𝔊𝔴𝔢𝔯𝔫@gwernJun 18Next up: I tried to do puns, but I'm not sure it really gets them, although I'm much more impressed with GPT-3 as a chatbot than any other chatbot I've tried. pic.twitter.com/CkEeLTND9U
56,129
3,658
6.5%
View Tweet activity
𝔊𝔴𝔢𝔯𝔫@gwernJun 18Using @slatestarcodex's Tom Swifties, I get ~10% hit rate; 22 Swifties yields 2 (!):
'"I'm having a layover in France, please let me know if you still want me to come over!" Tom said in passing'
'"She was kind of cute before all that plastic surgery", Tom said cosmetically.' pic.twitter.com/WMiveevJVC
55,015
3,334
6.1%
View Tweet activity
𝔊𝔴𝔢𝔯𝔫@gwernJun 18Everything after the '|' is GPT-3. Took a good hour of probing but I finally figured it out. Tell me again how this is 'just memorization'... 😁 twitter.com/gwern/status/1…
𝔊𝔴𝔢𝔯𝔫@gwernJun 29I read the PresGAN paper when it came out. I had not the slightest idea who the author was, and I have not cited it because why would I? The noise seems like any of scores of papers, and the evaluations were very weak: PresGAN was not even close to SOTA on even CIFAR-10.
45,710
7,172
15.7%
View Tweet activity
𝔊𝔴𝔢𝔯𝔫@gwernJun 15"Good work, K9s—we collared the cat burglar!", Tom panted.
39,583
120
0.3%
View Tweet activity
𝔊𝔴𝔢𝔯𝔫@gwernJun 29Looks like it's that time of year again, when we voyeuristically pore over Form 990s & make concerned clucking sounds over compute expenses: reddit.com/r/OpenAI/comme…
But seriously, did anyone followup on that DM legal stuff? How 𝘪𝘴 DM structured? Seems important for AI safety.
38,262
930
2.4%
View Tweet activity
𝔊𝔴𝔢𝔯𝔫@gwernJun 29GAN papers like this come out practically *every day* opn Arxiv. I can't even skim the abstracts, and nobody has ever read even a small fraction of the 'GAN Zoo'. There is absolutely no need to invoke racism or sexism to explain why PresGAN has not gotten much attention.
34,323
4,119
12.0%
View Tweet activity
𝔊𝔴𝔢𝔯𝔫@gwernJun 18Hah, I did it! I got Harry Potter GPT-3 literary style parodies! Turns out you have to push it into fiction-writing mode by writing part of the parody yourself, anything else and it wriggles out. But they're amazing: Wodehouse, Stoker, Yeats, Whitman...
pastebin.com/iyNKdrCz
33,667
7,467
22.2%
View Tweet activity
𝔊𝔴𝔢𝔯𝔫@gwernJun 16My deepest fear is that when people send me offers of sex or sexts via my anonymous feedback form, they're objectifying me and only interested in my mind.
31,076
1,522
4.9%
View Tweet activity
𝔊𝔴𝔢𝔯𝔫@gwernJun 10A quick demo testing out whether resizing (with black bars to fill in background) is better than random cropping on Figures. After ~149k steps, I'd say yes, it's a clearcut improvement.
(No need to ask which is which!) pic.twitter.com/tK21Fr5iQC
𝔊𝔴𝔢𝔯𝔫@gwernJun 11Advantage of archiving books in dumps over mountains or boreholes: near major population centers, easy & write-only, easily located, inherently deters looters, anaerobic & cannot be set on fire, typically water-proof, guaranteed future archaeologist interest in excavations...