CLIP + StyleGAN + #mylittlepony A thread 🧵starting with @ElvisPresley "A pony that looks like Elvis Presley" #AI #art #NLP #ML

Mar 8, 2021 · 12:00 AM UTC

9
46
18
235
CLIP + StyleGAN + #mylittlepony + @Beyonce
1
2
1
30
CLIP + StyleGAN + #mylittlepony + @billieeilish
2
2
38
Halftime shoutout: Props to @l4rz @AydaoAI @pbaylies @Norod78 for ideas and starting notebooks. Go check them out if you find this stuff interesting (signal boost activated). Here's the crazy bit, these were optimized using *only* the text, the photo for is for reference.
2
17
CLIP + StyleGAN + #mylittlepony + @katyperry
1
18
CLIP + StyleGAN + #mylittlepony + @taylorswift13
2
2
2
21
CLIP + StyleGAN + #mylittlepony + @justinbieber
1
1
27
CLIP + StyleGAN + #mylittlepony + @rihanna
2
20
Replying to @metasemantic @ElvisPresley
But how? This is incredible. Is it using the StyleGAN model from thisponydoesnotexist.net/ ?

This Pony Does Not Exist

TPDNE: A website showcasing AI-generated ponies made with friendship and magic.

thisponydoesnotexist.net
1
18
Yup, thanks @gwern et al! Here's what I found, surprisingly *don't* use the reference image as a CLIP image, only use the text (it confuses the model having both). I generated about 30 images each and sorted by the best match (this time using the ref CLIP sim to sort)
1
9
more replies
Replying to @metasemantic @ElvisPresley
alright who is turning this into a website because I'm already tempted
1
9
Happy to give you the code, but has some current drawbacks 1] only works on *text* it knows (could automate on images to, exploring that now!), 2] needs some cherry picking, only about 1/5 are really good
3
6
more replies
Load more