all 31 comments
sorted by:
best
formatting helphide helpcontent policy

[–]YouAgainShmidhoobuhML Engineer 42 points43 points  (3 children)

Probably want to rename the model at some point considering what happened to the hugginfaces model

[–]Deep-Station-1746 11 points12 points  (2 children)

Wh... what happened to the poor thing? 🥺

[–]royalemate357 40 points41 points  (1 child)

The Dalle-mini on huggingface spaces became viral, leading many people to become confused between "dalle-mini" and OpenAI's Dalle. OpenAI didn't like that and wanted the creator of Dalle-mini to change its name, so apparently the creator tried to protect the name "dalle-mini" by getting it trademarked. But OpenAI won so the creator ended up changing dalle-mini's name to Craiyon.

Relevant reddit thread: https://www.reddit.com/r/MachineLearning/comments/vhfp1t/n\_d\_openai\_who\_runs\_dalle2\_alleged\_threatened/

[–][deleted] 2 points3 points  (0 children)

Openai- not

[–]mileseverett 6 points7 points  (15 children)

How close to the full Dalle 2 is your Dalle Mega implementation?

[–]johnnydaggers 19 points20 points  (14 children)

It’s a completely different model and method.

[–]datachomper 5 points6 points  (2 children)

Will you be open-sourcing any code and/or writing as to how you created this implementation (from Imagen using the Laion-5b dataset)?

Would be a great learning opportunity for the community!

Here are some other implementations of Dalle clones in Pytorch by various authors in the ML and DL community: https://github.com/lucidrains/DALLE-pytorch

[–]wjeliot 1 point2 points  (1 child)

Nice question :) When the code's good and the model's ready I think we'll open source everything, as well as writing about our experience / learnings.

P.S. lucidrains' reproduction of Imagen has been really helpful to us too!

[–]LetterRip 0 points1 point  (0 children)

Are you using Imagen or Elucidated Imagen?

[–]mileseverett 3 points4 points  (10 children)

Oh this is based on the original Dalle, I see

[–]dillon101001 2 points3 points  (2 children)

Will it run on 16gb gpu?

[–]wjeliot 2 points3 points  (1 child)

Fingers crossed, but yes that's the plan for now.

[–]Somewanwan 1 point2 points  (0 children)

I'm looking forward to trying it out, it's always nice to see alternatives to latest models.

[–]thegreatjoke 0 points1 point  (2 children)

Awesome. How long to train / release?

[–]wjeliot 1 point2 points  (1 child)

We're still working out the logistics but hope to have it up and live within a couple of months. We might release early checkpoints if people want to see inference on an unfinished version of the model even sooner.

[–]johnnydaggers 0 points1 point  (1 child)

Are you doing that with the LAION discord group or separately?

[–]wjeliot 1 point2 points  (0 children)

Separately, although all of the discussion and work from LAION and their members obviously plays a huge part in our progress. I'm hoping one day we can collaborate.

[–]Deep-Station-1746 2 points3 points  (2 children)

Goddamnit I wanted to build that :D

Quick question, do you guys get billed for what you use? (GPU seconds, like serverless cloud function) or have a constant rate of $ per hour?

[–]paulcjh[S] 4 points5 points  (0 children)

We actually self host on our server farm, this is an additional product on top of our offering. We charge serverless GPU compute on a rate of $2 per hour on PipelineCloud that this runs on and you can use this model via API there.
Hope you enjoy it!

[–]brendanbennett 4 points5 points  (1 child)

That's pretty quick. Esp for mini. It's for free right?

[–]paulcjh[S] 2 points3 points  (0 children)

It is yeah!

[–][deleted] 1 point2 points  (3 children)

Still cannot get it to create a decent "cat knitting a pair of socks" 😂 For some reason this task appears to be out of reach for these models.

[–]DancesWithWhales 3 points4 points  (2 children)

cat knitting a pair of socks

Here's DALL-E's best attempt:

https://labs.openai.com/s/fCnwLnrwl3OeqCp8LmkDLZwH

[–][deleted] 2 points3 points  (1 child)

Oh, this is decent! Thank you! Is it the original DALL-E, or DALL-E2?

[–]DancesWithWhales 1 point2 points  (0 children)

This is DALL-E2! Yeah, I've been impressed with what it can do.

[–]Querey_Boy 1 point2 points  (2 children)

What does the price mean? Is that per download or if we are to use them in projects?

[–]wjeliot 5 points6 points  (1 child)

For playgrounds.ai there is no price; it's all completely free with no strings attached. The API which powers it is provided by Pipeline Cloud, where billing is on a $0.00000056-per-millisecond model so you only pay for what you use. An average task on DALL·E Mini takes 10 seconds (for 9 images), so amounts to roughly $0.00062 per task. You're free to download and use outputs from either Playgrounds or Pipeline Cloud however you like, no restrictions whatsoever!

[–]Querey_Boy 2 points3 points  (0 children)

Ok, cool. Thank you.

[–]pergala 0 points1 point  (0 children)

Fantastic! love it that there are no restrictions to what you can do with this!