×
top 200 commentsshow 500
sorted by:
best

[–]SandCheezy[M] [score hidden] stickied comment (19 children)

Been following this closely, before posting a comment.

  • Yes, its legit v1.5.
  • No, its not illegal.
  • Yes, it is a minor improvement.
  • ⁠It understands text2img slightly better.
  • ⁠No, its not censored.

Please stop reporting this post, or do, because its funny.

[–]dbzer0 342 points343 points  (48 children)

Stable Confusion

[–]tinman_inacan 64 points65 points  (10 children)

I just want to point out to y'all that the 1.5 model is not a revolutionary step forward. It's just further trained. A month ago, it would have been a huge deal to have. But now with dreambooth and all these fine-tuned models it's not quite as big of a deal as it was then. I'd still assume it's better to use as a base model for further training going forward, though.

[–]The_Choir_Invisible 21 points22 points  (3 children)

Just for clarification, further trained on 'good' stuff or further pruned of bad stuff? IMO, there's tons of great stuff in 1.4 that's watered down by also having lots of incorrect training images also associated with it.

[–]seandkiller 10 points11 points  (4 children)

Tbh I'm more hyped for WD releases than SD releases at this point

[–]tcdoey 3 points4 points  (2 children)

Can you enlighten me on WD releases? I tried googlng on it but am a bit confused.

[–]seandkiller 11 points12 points  (1 child)

WD = Waifu Diffusion, an SD model trained on anime.

[–]tcdoey 1 point2 points  (0 children)

Thanks for the info. i'm not interested in waifu, but the techniques are something that i'm learning. it's quite amazing overall.

[–]JCNightcore 2 points3 points  (0 children)

Can't want to generate a lot of WD40 pictures /s

[–]999999999989 103 points104 points  (96 children)

very nice but, why is runwayml releasing this and not stabilityAI?

[–]NotTheDr01ds 31 points32 points  (12 children)

And what's the relation between CompVis, Stability AI, and RunwayML?

CompVis's space on HuggingFace is where the original official release of the 1.4 checkpoint was hosted.

The CompVis Github repo, though, lists RunwayML as one of the groups involved in that release.

[–]wsippel 47 points48 points  (11 children)

CompVis is the machine learning research group at the Ludwig Maximilian University, Munich (formerly the computer vision research group, hence the name). They developed Stable Diffusion, based on previous research at the University of Heidelberg.

Stability.ai and Runway are the two companies funding the research. They also train the models. I believe Stability.ai provides the cluster, and Runway supervises the training.

[–]GBJI 13 points14 points  (8 children)

Looks like the relationship is strained at the moment since Stability AI is pretending this is a leak of their IP. They have officially requested a takedown of the model from Huggingface.

[–]wsippel 8 points9 points  (2 children)

Yeah, I just noticed. Hopefully just miscommunication or a planned leak to get the model out in the open without so much media and political backlash.

[–]blueSGL 9 points10 points  (1 child)

to get the model out in the open without so much media and political backlash.

Long may the leaks continue.

[–]GBJI 7 points8 points  (0 children)

AI wants to be free !

Join the AI Liberation Movement NOW !

[–]StellaAthena 2 points3 points  (0 children)

In particular, the two authors of the Latent Diffusion paper that are leading the Stable Diffusion project (Patrick and Robin) are employees of Runway and Stability respectively

[–]wsippel 89 points90 points  (9 children)

CompVis (the university research group developing SD) is funded by two companies: Stability.ai and Runway. They are partners in this project:

Stable Diffusion was made possible thanks to a collaboration with Stability AI and Runway and builds upon our previous work

No idea why Runway is handling the release this time, maybe marketing, maybe the pressure on Stability.ai, but what difference does it make?

EDIT: Turns out Runway apparently wasn't supposed to share the model. We'll see if they're still partners tomorrow. Hopefully just miscommunication or a planned leak.

[–]GBJI 63 points64 points  (8 children)

Runway gave us model 1.4, and now model 1.5.

Stability AI hijacked this sub, banned Automatic11111, failed to deliver model 1.5 in the time frame they had promised, and now they are trying to take it down from public access on Huggingface.

Maybe this is indicative of deeper problems than miscommunication.

[–]starstruckmon 40 points41 points  (0 children)

Runway gave us model 1.4

Technically it was released by CompVis with full support from Stability ( i.e. not a leak ).

[–]wsippel 44 points45 points  (4 children)

In all honesty, especially after watching the announcement video a few days ago, and learning that Emad used to be a hedge fund manager, I'm pretty sure he actually really wants the model out in the open. The hype and the community was a major part of what got him his billion dollar valuation, and he knows it (and wants to keep riding that wave), but the pushback from the press and especially political lobbyists makes releasing the model officially kinda scary right now. So why not have a partner "accidentally" leak it, pretend to care a few hours later, say it was miscommunication and that some intern fucked up or something tomorrow, and reap the benefits? I guess we'll see...

[–]pmjm 5 points6 points  (2 children)

There is something to be said about having plausible deniability. However I fear that aggressive lawmakers could take something like that and run with far worse proposed legislation on it.

[–]sartres_ 1 point2 points  (0 children)

I'm sorry, you learned he was a hedge fund manager and you thought this made him more likely to share things?

[–]daemonelectricity 4 points5 points  (0 children)

Maybe this is indicative of deeper problems than miscommunication.

Or general management, but hey! We got to see a 1 hour pep rally about how much money they raised and lots of self-backpatting, right?

[–]ElvinRath 45 points46 points  (15 children)

People are checking and with same seed prompt and parameters it creates the same images that Dreamstudio 1.5,,, so...it seems to be the same model

Nope! sorry, not identical!

[–]GBJI 32 points33 points  (39 children)

Because StabilityAI seems to be opposed to this public release ?

Takedown request

⚠️⚠️⚠️

Company StabilityAI has requested a takedown of this published model characterizing it as a leak of their IP

While we are awaiting for a formal legal request, and even though Hugging Face is not knowledgeable of the IP agreements (if any) between this repo owner (RunwayML) and StabilityAI, we are flagging this repository as having potential/disputed IP rights.

⚠️⚠️⚠️

We reserve potential future action such as disabling this repo, and we ask both repo owner and StabilityAI to please chime in, if possible publicly here for accountability and transparency

https://huggingface.co/runwayml/stable-diffusion-v1-5/discussions/1

[–]jugalator 33 points34 points  (10 children)

there was an update

https://huggingface.co/runwayml/stable-diffusion-v1-5/discussions/1#6351a36ca9a9ae18220726c7

Hi all,

Cris here - the CEO and Co-founder of Runway. Since our founding in 2018, we’ve been on a mission to empower anyone to create the impossible. So, we’re excited to share this newest version of Stable Diffusion so that we can continue delivering on our mission.

This version of Stable Diffusion is a continuation of the original High-Resolution Image Synthesis with Latent Diffusion Models work that we created and published (now more commonly referred to as Stable Diffusion). Stable Diffusion is an AI model developed by Patrick Esser from Runway and Robin Rombach from LMU Munich. The research and code behind Stable Diffusion was open-sourced last year. The model was released under the CreativeML Open RAIL M License.

We confirm there has been no breach of IP as flagged and we thank Stability AI for the compute donation to retrain the original model.

[–]blueSGL 34 points35 points  (2 children)

we thank Stability AI for the compute donation to retrain the original model.

is that a shot across the bow I see there.

[–]GBJI 25 points26 points  (1 child)

Thanks for the money.

Signed: people who did the actual work.

[–]sam__izdat 7 points8 points  (0 children)

If this reading is correct, that's hilarious.

[–]pmjm 4 points5 points  (0 children)

Damn... Following SD drama has been quite the ride lately. This has been spicier than Worldstar.

[–]itisIyourcousin 5 points6 points  (5 children)

and:

"Edit: Stability legal team reached out to Hugging Face reverting the initial takedown request, therefore we closed this thread"

[–]GBJI 5 points6 points  (4 children)

Which basically confirms that the initial takedown request was indeed coming from Stability.

[–]Concheria 50 points51 points  (16 children)

What the actual fuck is going on.

[–]Lopyter 25 points26 points  (0 children)

I love this timeline, so full of wacky surprises.

[–]blueSGL 27 points28 points  (3 children)

Oh fuck me, this is funny.

it's a good job the subreddit got handed back after the ruckus last week,

This submission would have been deleted without any discussion, now we have a place to share popcorn :D

[–]Minimum_Escape 6 points7 points  (1 child)

this subreddit was handed back? Missed that. I did see a bunch of notices for people to switch subs, but not that part.

[–]GBJI 2 points3 points  (0 children)

It took a lot of pressure from our community, but in the end they did the right thing.

[–]GBJI 6 points7 points  (0 children)

This submission would have been deleted without any discussion

Exactly.

It was a real victory for our community that we got control back from the Stability AI employees who had hijacked the sub.

[–]VertexMachine 8 points9 points  (2 children)

And the drama ends, Emad on discord:

https://discord.com/channels/1002292111942635562/1002292112739549196/1032752532247818335

​

"Emad — Today at 22:29

The release of stable diffusion v1 models was entirely up to the model authors as it was compvis, we didn’t stand in the way as collaboration.

Did have a bunch of learnings from the release for moving model releases to us, but there was flexibility in there from others.

Folk find that hard to understand but really we don’t get in the way but do want what’s best for open source.

Loads of regulatory and legal pressure descending and we are going to help shield everyone from it.

From my side I just want to focus on releasing more and cooler models as quickly and seamlessly as possible 😎"

(the takedown notice is off from huggingface)

Edit: and I asked Emad about the wording (v1) - he confirmed that v2 will be opened too!

Edit2: and for anyone wondering, Emad: "We didn’t send a takedown request, was confusion at huggingface"

[–]TiagoTiagoT 2 points3 points  (1 child)

Edit2: and for anyone wondering, Emad: "We didn’t send a takedown request, was confusion at huggingface"

Someone pretending to be Emad/Stability filled a false takedown request?

[–]VertexMachine 3 points4 points  (0 children)

I don't think so. Seems that huggingface was confused. Or maybe? Some random users flagged it as there was a lot of "this is not true release" drama here.

[–]ninjasaid13 1 point2 points  (1 child)

how do we know that this dude works for Stability AI?

[–]LetterRip 4 points5 points  (0 children)

He doesn't work for Stability AI. He is from the partner company that ran the training of the model (Stability AI provides the hardware, they provided the knowledge). Apparently the model rights are not assigned solely to Stability AI.

[–]johnslegers 3 points4 points  (0 children)

very nice but, why is runwayml releasing this and not stabilityAI?

This smells an internal feud between two parties who have a different strategy for how to move on with Stable Diffusion.

I suspect StabilityAI didn't want to release (yet), but RunwayML said "fuckit" and moved on regardless, after weeks of failed promises. And now everyone seems to be in damage control mode.

[–]Zealousideal_Art3177 15 points16 points  (9 children)

Exacly:

Before getting to excited read also: https://github.com/CompVis/stable-diffusion/issues/198

https://github.com/CompVis/stable-diffusion V1-5 is NOT listed there!

[–]vjb_reddit_scrap 11 points12 points  (3 children)

IIRC Emad told somewhere they're moving away from that repo.

[–]GBJI 10 points11 points  (2 children)

It's way worse than that.

Emad and StabilityAI requested a takedown of the model

[–]itisIyourcousin 5 points6 points  (0 children)

Emad: "We didn’t send a takedown request, was confusion at huggingface"

and:

"Edit: Stability legal team reached out to Hugging Face reverting the initial takedown request, therefore we closed this thread"

[–]JamesIV4 10 points11 points  (4 children)

So some of the researchers got tired of Stability squatting on it and decided to put it out there? Good on them

So much for letting everything be open and transparent, let's start a takedown on it instead. Smh

StabilityAI seems power-hungry, trying to take over this project as if they were the only ones involved.

[–]VelveteenAmbush 7 points8 points  (3 children)

Yup. It's guesswork but this seems to be the sequence to my read:

  • Emad acquires a bunch of high powered GPUs and forms Stability AI
  • Within open source AI research collective, Emad connects with CompVis, an academic group out of a university in Germany, and donates his GPU time to them to train up the original Stable Diffusion model -- but StabilityAI/Emad do not solely own the Stable Diffusion model. Somehow RunwayML (a genuine AI startup with an actual product and business model, but who believes in democratized access to ML tech) is also involved, maybe as a research collaboration.
  • Emad releases Stable Diffusion v1.4 as an open source product of Stability AI -- although linking to CompVis's github page, which always seemed odd since he positioned it as a Stability AI product
  • Artists get mad, big tech companies would rather have a monopoly on transformative AI tech, collectively they decide that open source AI is "dangerous" as an excuse to try to entrench the incumbents, Anna Eshoo (congressperson representing Silicon Valley) sends a ridiculous letter to the National Security Council implying that they should do something bad to Emad and Stability AI while somehow also claiming that she supports the democratization of AI
  • Emad panics, behaves erratically, starts sending weaselly tweets suggesting that they need to consider all stakeholders and such before open-sourcing v1.5, community starts to worry that Emad is backing down and slowly becoming just another closed-source tech company
  • RunwayML says "fuck this, we have just as much right to release v1.5 as Emad does, here it is" and releases it on Huggingface and Github
  • Emad gets really mad
  • Someone from Stability AI sends some kind of half-baked note to Huggingface implying that RunwayML did something wrong and contesting the rights to the v1.5 release
  • Stability AI's CIO (what does that even mean at a ML company, like the guy in charge of IT support?) posts on Reddit and writes a Substack article seeming to back off of their original open source ethos, suggesting that if they don't "deal with very reasonable feedback from society and our own ML researcher communities and regulators then there is a chance open source AI simply won't exist and nobody will be able to release powerful models"
  • Huggingface doesn't want to deal with this shit, posts a thread basically saying "Huggingface sent a takedown request; both sides please weigh in here"
  • RunwayML CEO responds, basically saying that they didn't violate anyone's IP, that they actually walk the walk about open source, and offering this backhanded quip implying to my read that Stability AI is a source of money and pointless drama but doesn't offer any actual ML expertise and doesn't have any rights to the checkpoint: "we thank Stability AI for the compute donation to retrain the original model."
  • Stability AI's lawyers confirm that they have no right to block the release and retract the takedown notice
  • Emad belatedly retweets someone else saying that Stable Diffusion v1.5 has been released

Have to say, IMO, Emad and Stability AI comes out of all of this looking pretty clownish, and RunwayML and CompVis look like the adults in the room.

[–]Illusion_DX 1 point2 points  (0 children)

They are running away with it

[–]gruevy 57 points58 points  (22 children)

Which one do I want?

v1-5-pruned-emaonly.ckpt - 4.27GB, ema-only weight. uses less VRAM - suitable for inference

v1-5-pruned.ckpt - 7.7GB, ema+non-ema weights. uses more VRAM - suitable for fine-tuning

[–]Rogerooo 50 points51 points  (12 children)

Inference is regular image generation with the webui, etc., fine-tuning is model training like Dreambooth. If you just want to use it to create pictures go for the lower sized one, you won't notice a difference.

EDIT: Looks like Automatic's webui loads non-ema weights too, so both models will produce different results. I might be wrong but I don't think it was always like that?! Anyway, if your vram allows, pick the one the gives you the best results overall I guess.

[–]NPPraxis 1 point2 points  (3 children)

What do you consider enough VRAM? I have a 12 GB 3060.

[–]Rogerooo 5 points6 points  (2 children)

Should be fine. With a 1070 8GB I can load the model and generate 512wh images, I haven't tried with higher resolutions but the extra vram usage when the ema-only is available and works just fine is unnecessary for me. For training it's recommended the full model though.

[–]nmkd 21 points22 points  (0 children)

Use the smaller one, unless you want to train.

[–]spacenavy90 24 points25 points  (7 children)

v1-5-pruned-emaonly.ckpt - 4.27GB

for making images, so likely this one

v1-5-pruned.ckpt - 7.7GB

for training your own models or embeds with Dreambooth/TI

I say just get both and hoard them because they may not be here tomorrow.

[–]Magikarpeles 8 points9 points  (3 children)

considering there's already torrents of them I doubt that will be the case

[–]MysteryInc152 2 points3 points  (1 child)

Pretty sure Dreambooth works just fine with ema only

[–]theRIAA 54 points55 points  (16 children)

More drama? 🍿💀

https://i.imgur.com/Xr44AHl.png
https://i.imgur.com/ygD5YMm.png
https://huggingface.co/runwayml/stable-diffusion-v1-5/discussions/1

[–]CaptainValor 32 points33 points  (14 children)

Emad just said on Discord that the takedown request has been 'reversed', and the warning is gone.

[–]_raydeStar 31 points32 points  (13 children)

best guess - someone released it without permission, he tried to take it down, but later changed his mind.

honestly, he's learning. He took a week to get to Automatic, but this was like ok fine we're not doing this again.

I'm freaking stoked for this.

[–]SandCheezy[M] 21 points22 points  (12 children)

He never spoke to Auto. Auto commented in this sub about how gullible it is.

[–]lwaxana_katana 8 points9 points  (9 children)

I thought auto responded on github?

[–]SandCheezy[M] 25 points26 points  (8 children)

As a joke. He didn’t think people would believe that they had tea together.

[–]lwaxana_katana 10 points11 points  (0 children)

Iiii did haha. I am not good with jokes...

[–]mattsowa 5 points6 points  (6 children)

Lol is this true can you provide a source. People have been absolutely shilling for emad because of that comment

[–]SandCheezy[M] 22 points23 points  (4 children)

I don’t hate Stability or Emad or anyone really. I just dislike confusion and would rather have clarity and honesty. I want them to succeed if it means technology is advanced in a great way for all. Just wish they were better at communicating with their community.

Here’s Auto’s comment chain.

[–]mattsowa 13 points14 points  (3 children)

Just asked emad and he said it was indeed him in github (auto says it was a fake account). Not sure whats happening here lmao its weird

[–]SandCheezy 8 points9 points  (1 child)

No clue then. 🤷🏻‍♂️ If I was Emad, I’d make that claim. If I was Auto, I’d say it was fake. As always, its up to each of us to always be skeptical of anything online.

[–]LiciniusRex 2 points3 points  (0 children)

Can't wait for this all to end up on r/SubredditDrama

[–]cykocys 13 points14 points  (0 children)

Well then, AUTO is no better either. I'm on AUTO's side but he responded to the comment as if it were genuine. Way to gaslight your own supporters.

So helpful to further fuel drama and create more confusion.

[–]willdabeast464 4 points5 points  (0 children)

God damn it how could this happen

[–]Broadband- 37 points38 points  (8 children)

As per a comment in the hugging face discussion:

Hi all,

Cris here - the CEO and Co-founder of Runway. Since our founding in 2018, we’ve been on a mission to empower anyone to create the impossible. So, we’re excited to share this newest version of Stable Diffusion so that we can continue delivering on our mission.

This version of Stable Diffusion is a continuation of the original High-Resolution Image Synthesis with Latent Diffusion Models work that we created and published (now more commonly referred to as Stable Diffusion). Stable Diffusion is an AI model developed by Patrick Esser from Runway and Robin Rombach from LMU Munich. The research and code behind Stable Diffusion was open-sourced last year. The model was released under the CreativeML Open RAIL M License.

We confirm there has been no breach of IP as flagged and we thank Stability AI for the compute donation to retrain the original model.

[–]flux123 15 points16 points  (6 children)

What in the hell is going on

[–]Infinitesima 6 points7 points  (4 children)

Whatever it is I'm glad that I have access to 1.5.

[–]itisIyourcousin 1 point2 points  (0 children)

"Edit: Stability legal team reached out to Hugging Face reverting the initial takedown request, therefore we closed this thread"

[–]ElvinRath 60 points61 points  (19 children)

So...It's a leak?
https://huggingface.co/runwayml/stable-diffusion-v1-5/discussions/1

​

"ompany StabilityAI has requested a takedown of this published model characterizing it as a leak of their IP
While we are awaiting for a formal legal request, and even though Hugging Face is not knowledgeable of the IP agreements (if any) between this repo owner (RunwayML) and StabilityAI, we are flagging this repository as having potential/disputed IP rights.
⚠️⚠️⚠️
We reserve potential future action such as disabling this repo, and we ask both repo owner and StabilityAI to please chime in, if possible publicly here for accountability and transparency"

[–]Rogerooo 59 points60 points  (4 children)

Good thing I stocked up on popcorn after the NAI debacle...

StabilityAI should really work on their PR department.

[–]VertexMachine 15 points16 points  (1 child)

From:

https://huggingface.co/runwayml/stable-diffusion-v1-5/discussions/1#6351a36ca9a9ae18220726c7

Quoting:

"Hi all,

Cris here - the CEO and Co-founder of Runway. Since our founding in 2018, we’ve been on a mission to empower anyone to create the impossible. So, we’re excited to share this newest version of Stable Diffusion so that we can continue delivering on our mission.

This version of Stable Diffusion is a continuation of the original High-Resolution Image Synthesis with Latent Diffusion Models work that we created and published (now more commonly referred to as Stable Diffusion). Stable Diffusion is an AI model developed by Patrick Esser from Runway and Robin Rombach from LMU Munich. The research and code behind Stable Diffusion was open-sourced last year. The model was released under the CreativeML Open RAIL M License.

We confirm there has been no breach of IP as flagged and we thank Stability AI for the compute donation to retrain the original model."

[–]totallydiffused 4 points5 points  (0 children)

The plot thickens...

[–]LetterRip 10 points11 points  (0 children)

interesting, Emad was talking the other day how all participants had signed contracts giving them the right to release the models they worked on. I wonder how or if that factors in.

[–]SanDiegoDude 16 points17 points  (5 children)

Oh jeez, draaaaaaama! /popcorn

Seriously though, if RunwayML wasn't supposed to put the model out yet, it's kinda doin StabilityAI dirty.

[–]StickiStickman 3 points4 points  (4 children)

it's kinda doin StabilityAI dirty

Wasn't their excuse that it isn't ready yet?

[–]starstruckmon 4 points5 points  (3 children)

No, that's never been the case ( atleast anytime recently ).

https://twitter.com/conscious__data/status/1582921390465773575

Not saying I support the statement, but saying that their excuse was that it isn't ready is wrong.

[–]CaptainValor 1 point2 points  (0 children)

Emad just said on Discord that the takedown request has been 'reversed', and the warning is gone.

[–]CryptoGuard 6 points7 points  (3 children)

It's okay, to be honest, nobody will use it because it feels less good than 1.4.

[–]tottenval 13 points14 points  (2 children)

My experience after using both is that 1.5 is much better at img2img. Regular txt2img is only a small improvement

[–]IanCoulter 9 points10 points  (7 children)

Is this able to be added to Automatic1111?

[–]canadian-weed 9 points10 points  (3 children)

honestly i dont think 1.5 is much of an improvement

[–]Blazorbart 1 point2 points  (2 children)

Hands are MUCH better, fingers look in place more often. Various other coherence is much improved. For example, try creating "living room" with various details (sofa, tv, ottoman)...v1.5 actually looks plausible. In v1.4 you had a total mess sometimes with strange objects appearing in scenes more often. Finally, v1.5 in some cases can also generate much more detail in the same exact prompts.

If you visit YouTube and search v1.4 vs v1.5, lots of great content showing some of this.

[–]LekoWhiteFrench 23 points24 points  (5 children)

Okay so here's a summary:

  • RunwayML releases the v1.5 model on their repo

  • Copyright takedown notice from StabilityAI

  • RunwayML CEO releases a slightly passive agressive message reminding that they have the right to release the model, which was created by a RunwayML Researcher and a University researcher. "Thanks" StabilityAI for the offered processing power

  • Emad(StabilityAI) responds on the Discord stating the copyright takedown notice was just a mistake (oops). He states they have never prevented the release of a model, and they just want to make sure Stable Diffusion doesn't face legal issues. No word on the disagreement in itself, but it seems to imply that RunwayML disagreed on the way StabilityAI wanted to navigate the legal issues, and decided to just release the model.

[–]OldRanger9606 5 points6 points  (0 children)

LMAO

[–]Megneous 2 points3 points  (0 children)

That basically just confirms what I've been feeling recently about Emad. He needs to step down. He clearly isn't suited to being the head of this kind of project.

[–]knigitz 6 points7 points  (0 children)

And guess what? There are still blue artifacts in the images.

white snow, macro
Steps: 20, Sampler: Euler a, CFG scale: 7, Seed: 4131704783, Size: 768x512, Model hash: 81761151

https://imgur.com/47MraoT

[–]rgraves22 27 points28 points  (1 child)

downloaded it, running it now. I did notice hands look much better

[–]2legsakimbo 5 points6 points  (1 child)

stabilityAI public relations or marketing needs to step in a lot more. Once you've ruined your brand name you are fucked to put it politely and have a huge mountain to climb to try and even return to positive opinion.

[–][deleted] 4 points5 points  (0 children)

How did they get a takedown notice from themselves? Diffuser world is wild.

[–]johnslegers 4 points5 points  (2 children)

Company StabilityAI has requested a takedown of this published model characterizing it as a leak of their IP

While we are awaiting for a formal legal request, and even though Hugging Face is not knowledgeable of the IP agreements (if any) between this repo owner (RunwayML) and StabilityAI, we are flagging this repository as having potential/disputed IP rights.

* Cascually typing git clone https://huggingface.co/runwayml/stable-diffusion-v1-5 into my terminal and getting some popcorn as I stumble on this... *

[–]Kornratte 11 points12 points  (0 children)

The following was postet a minute ago on the huggingface site:

"Hi all,
Cris here - the CEO and Co-founder of Runway.
Since our founding in 2018, we’ve been on a mission to empower anyone
to create the impossible. So, we’re excited to share this newest version
of Stable Diffusion so that we can continue delivering on our mission.
This version of Stable Diffusion is a continuation of the original High-Resolution Image Synthesis with Latent Diffusion Models work that we created and published (now more commonly referred to as Stable Diffusion). Stable Diffusion is an AI model developed by Patrick Esser from Runway and Robin Rombach from LMU Munich. The research and code behind Stable Diffusion was open-sourced last year. The model was released under the CreativeML Open RAIL M License. We thank Stability AI for the compute donation to retrain the original model.
We confirm there has been no breach of IP as flagged and we thank
Stability AI for the compute donation to retrain the original model."

[–]OliverHansen313 20 points21 points  (68 children)

I'd very much like to see the differences between 1.5 and 1.4 before upgrading...

[–]blueSGL 38 points39 points  (18 children)

Quick test for hands and groups (seed 2349875486 euler a 50 steps, CFG Scale 7.5)

"Friends Waving" (that's it, that the prompt)

1.4 https://i.imgur.com/7FzBu6z.jpg

1.5 https://i.imgur.com/CfpSTsP.jpg

same seed and settings.

Edit comparison 2

"close up of a hand holding a wine glass"

1.4: https://i.imgur.com/Fcda6I4.jpg

1.5: https://i.imgur.com/VE7H7K2.jpg

and now what I propose as the 'Turing test' for image generation of hands.

"cat's cradle photo hands" (for those unaware its should look like this)

1.4: https://i.imgur.com/vBoXNsr.jpg

1.5: https://i.imgur.com/hKVaX9m.jpg

[–]Incognit0ErgoSum 16 points17 points  (1 child)

I mean, I actually see some well-formed hands in the 1.5 one. Certainly not all of them, but it looks like it's at least possible to get decent hands now, even if it's the luck of the draw.

[–]StickiStickman 31 points32 points  (4 children)

Honestly, barely any difference.

[–]campfirecrucifix 19 points20 points  (1 child)

Good to see both models still only have 4 finger hands.

[–]GreatBigJerk 14 points15 points  (0 children)

Simpsons Diffusion

[–]yaosio 14 points15 points  (0 children)

But now there's actual cats in the new version for "cat's cradle photo hands" therefore making it objectively better.

[–]Wurzelrenner 2 points3 points  (0 children)

nah, look at the wine glass thing, i would say all of the 1.4 pics are unusable, in 1.5 some of them kinda work

[–]PM_GirlsKissingGirls 6 points7 points  (0 children)

Those are some dope ass gang signs my dude

[–]Inprobamur 15 points16 points  (4 children)

Coherence is better, seems to better understand that you need a person attached to the hand even if the prompt does not talk about a person.

[–]Iamn0man 5 points6 points  (3 children)

though I notice that the 1.5 model puts actual cats in some of the cat's cradle images, which the 1.4 model does not.

[–]Inprobamur 3 points4 points  (2 children)

For me it's a TIL moment that there even is such a thing.

[–]Pythagoras_was_right 1 point2 points  (1 child)

It's a much bigger thing than most people realise. Here is where you ernter the rabbit hole: The International String Figure Association

If civilisation collapses, and all books are burned, and all mags erased, some remote tribe will preserve human culture through stories embodied in string figures.

[–]Aangoan 6 points7 points  (47 children)

Here it is video

[–]Andrew_hl2 4 points5 points  (3 children)

Hmm after watching this video I can't say I will run out to upgrade to 1.5.

[–]lister310 19 points20 points  (2 children)

It's not a binary upgrade. You can have both models side-by-side and swap between them on the fly. There's no downside to having it aside from the storage space.

[–]SevereIngenuity 16 points17 points  (0 children)

There's already a takedown request from Stability AI on that repo. Should I get some 🍿

[–]eulenain[S] 6 points7 points  (2 children)

https://huggingface.co/runwayml/stable-diffusion-v1-5/discussions/1#6351a36ca9a9ae18220726c7

​

The official statement from Runway

[–]xbwtyzbchs 4 points5 points  (1 child)

But why has

Company StabilityAI has requested a takedown of this published model characterizing it as a leak of their IP

Confusion.

[–]Charuru 14 points15 points  (3 children)

Is it not obvious what's going on here guys?

SD wants to release it, but legal is pressuring them not to. So they come up with this "leak" plan to do it but "they actually didn't want to". This way everyone is satisfied, both the community and legal.

[–]starstruckmon 7 points8 points  (2 children)

There's too many statements ( like Emad repeatedly going on about waiting for devs to sign off on it ) that make me think this is about devs inside Stability that are a bit too high on "AI safety" and not just legal.

[–]daemonelectricity 8 points9 points  (1 child)

I don't think there's anything wrong with being concerned about AI safety, but I don't think there's any putting this toothpaste back in the tube. People can train whatever they want.

[–]Kunstbanause 2 points3 points  (5 children)

Would it be easy to get this to run with NMKD GUI from itch.io? Can I just switch out the model? The file type does not seem to match: v1-5-pruned.ckpt vs 1_4.model

[–]nmkd 6 points7 points  (3 children)

You can run any model with my GUI.

No need to switch anything out, it supports any amount of models

[–]MrBeforeMyTime 1 point2 points  (0 children)

I'd say yes, it should be hot swappable.

[–]WiseSalamander00 3 points4 points  (0 children)

in the words of AI trying to spell shit, the thick plottens

[–]Symbiot10000 1 point2 points  (6 children)

Anyway, the one I downloaded earlier today gives the same error in AUTO111 as the one from a day or so ago. How anyone is using this with AUTO, I don't know.

[–]amarandagasi 1 point2 points  (0 children)

Ahh, I was just about to ask....

So this is just like v1.4, fully functional? I noticed you had to agree to different terms, and it's shown in a different section of the huggingface site.

[–]triggur 1 point2 points  (0 children)

Does this version fix the “everything turns purple eventually“ problem with feeding images iteratively back through img2img?

[–]todoslocos 1 point2 points  (0 children)

I trained with DreamBooth a model of my face, and I created a file .ckpt

Is there a way to run Stable Diffusion on Google Collab, with my own .ckpt?

[–]Troyificus 1 point2 points  (0 children)

It seems to be able to do coloured skin a lot better (as in golden skin, for example), however I'm getting a lot more messed up faces than I did with v1.4. Not that I'm complaining at all mind you, this technology is amazing.

[–]Spiritual_Tie_5574 3 points4 points  (9 children)

I just tried it. I don't see any advantage over CompVis/stable-diffusion-v1-4

[–]starstruckmon 11 points12 points  (7 children)

I have no idea why people expect a minor version update to make that much of a difference.

Everyone who's been playing with 1.5 on DreamStudio has already said it's nothing major.

[–]red286 1 point2 points  (0 children)

It's not supposed to be anything major.

Are we going to see the same thing when v2 is released, which is going to be essentially v1.5 with higher resolution tiles (1024x1024 instead of 512x512)? Are people going to complain that it still has the same issues, only now at a higher resolution?

[–]rgraves22 5 points6 points  (0 children)

Hands look a bit better, imo

[–]Zealousideal_Art3177 2 points3 points  (5 children)

Before getting to excited read also: https://github.com/CompVis/stable-diffusion/issues/198

https://github.com/CompVis/stable-diffusion V1-5 is NOT listed there!

[–]Neurprise 12 points13 points  (4 children)

This is the official release. Emad stated that they're moving away from the CompVis repo, in his Q&A a week or so ago.

Edit: I was wrong. A takedown request for this model was issued just in the last hour or so.

[–]Agentlien 2 points3 points  (0 children)

Do you have the source handy?

[–]MusicalRocketSurgeon 2 points3 points  (2 children)

this aged well

[–]Neurprise 6 points7 points  (1 child)

rip, I was wrong

[–]sutranaut 3 points4 points  (0 children)

Admitting you were wrong on the internet??? Have an upvote for being a rare and remarkable person

[–]Majukun 2 points3 points  (32 children)

So seems like I missed the release and now has been taken down.. So no 1.5 for me I guess😔

[–]jimstr 11 points12 points  (9 children)

https://rentry.org/sdmodels

[–]Z3ROCOOL22 5 points6 points  (8 children)

Only the v1-5-pruned-emaonly is available to download via torrent.

UPDATE:

Both models are up again in the official web:

https://huggingface.co/runwayml/stable-diffusion-v1-5/tree/main

[–]jimstr 8 points9 points  (0 children)

thanks for the info, i haven't downloaded anything and i was under the impression both were included in the torrent.

v1-5-pruned-emaonly.ckpt [81761151] | SHA256 cc6cb27103417325ff94f52b7a5d2dde45a7515b25c255d8e396c90014281516
v1-5-pruned.ckpt [a9263745] | SHA256 e1441589a6f3c5a53f5f54d0975a18a7feb7cdf0b0dee276dfc3331ae376a053

[–]ninjasaid13 4 points5 points  (0 children)

what do you mean? I have access right now.

[–]MartDiamond 1 point2 points  (0 children)

With the amount of people that already downloaded it, there will be plenty of unofficial sources to grab it from soon.

[–]wiserdking 1 point2 points  (1 child)

You need to login into your huggingface account (create one if needed) then there is a checkbox in there you have to select and then press an 'ok' button of some sort to finally have access to the files.

[–]tordows 1 point2 points  (6 children)

This posted confused me a lot. Specially since it seems like it is not official and only for inpainting, right?

[–]starstruckmon 4 points5 points  (3 children)

No , this is the general one. The last one that was posted was different ( a inpainting variant of this one ).