This is great! Now that the model can be used in PyTorch, I've starting playing with @AydaoAI's anime StyleGAN directly guided by CLIP. Starting slow by searching for Asuka by name in the latent space.

Jan 24, 2021 ยท 9:24 PM UTC

Doesn't get the face right, but it's going somewhere. ๐Ÿ˜„
Can it generate "a dog"? Not yet, at least.
Replying to @advadnoun @AydaoAI
Are you doing some form of gradient descent? Didnโ€™t think thatโ€™d work too well, sweet if it does
Yeah, this is maximizing CLIP's text & image encodings cosine similarity by learning the latent vector given to the StyleGAN network.
Replying to @advadnoun @AydaoAI
got this for Kermit the Frog