NovelAI Diffusion has arrived!
The time is finally upon us. NovelAI's Image Generation is now live!
Let's get to the point quickly!
The NovelAI Diffusion Anime image generation experience is unique and tailored to give you a creative tool to visualize your visions without limitations, allowing you to paint the stories of your imagination.
You can now use tags to define the visual characteristics of your character or composition (or you can let AI interpret your words if you prefer!)
We decided to release NovelAI Diffusion Anime (Curated) and (Full) models as standalone releases:
NovelAI Diffusion Anime (Curated) Good baseline quality and predictable subject matter.
NovelAI Diffusion Anime (Full) The expanded training set allows for a wider variety of generations.
In addition to the NovelAI Diffusion Anime models, we are also shipping with the NovelAI Diffusion Furry (Beta):
NovelAI Diffusion Furry (Beta)Easily create Furry and Anthropomorphic Animal themed content. This model is not a complete work and will be expanded upon as development proceeds.
Let's focus on what makes NovelAI Diffusion so unique!
Tagging:
The team seized the opportunity to fill a gap in existing Image Models knowledge and teach the AI about tags!
When you type your image generation prompt, tagging suggestions will appear.
Let the AI help you focus your prompt!
Our finetuned NovelAI Diffusion model allows you to give the AI much clearer instructions on what to generate. The AI will suggest tags based on what you type and display corresponding circle markers indicating how much knowledge it has of each tag. Since the AI was trained with specific tags, it will be able to recognize labeled definitions much better, resulting in more consistent generations.
The AI knows a lot about trees, much less woodland camouflage, though!
The use of tags is not required, but they can play a critical role in steering the AI in the direction you want. We highly recommend a mix of tags and normal text prose. If used to create a 'character' of your own, you can create the illusion that all your generations display a consistent character.
Euterpe's visual tags are hard at work!
Euterpe Tags: auburn brown hair, very long hair, hair between eyes, hair flowers, flowers, updo, flower hair pins, extra long hair, green eyes, updo hair, golden neck, skinny, tall, thin
Pricing & Features:
For Opus Subscribers: We will offer access to unlimited basic generations at up to 640 x 640 pixels at no additional cost.
This includes all Image Resolutions under the "Normal" and "Small" dropdown categories.
The Image Resolutions Dropdown section applicable to Opus subscribers' coverage.
Normal includes: Portrait (512 x 768 pixels), Landscape (768 x 512 pixels) and Square (640 x 640 pixels).
Small includes: Portrait (384 x 640 pixels), Landscape (640 x 384 pixels) and Square (512 x 512 pixels).
The Opus tier offers unlimited generations with select settings, while the lower tiers are perfect for experimenting to find out if NovelAI's Image Generation service fits your needs.
Pricing is highly dependent on resolution size, the number of diffusion steps used, and the number of images generated in a single generation.
We encourage you to explore NovelAI Diffusion in this rapidly evolving market. Features and advancements are still being made, and we will be listening to your feedback as we continue to develop.
The New Currency
Steps have served us well, especially when they were just meant to allow you to train modules. However, we ran into the issue of Image Generation Steps overlapping with our already existing Step currency (to the training of our Custom AI Modules used in our Text Models, which at the time were named for that purpose only. To avoid any confusion, we decided there should only be one currency. So we've taken this opportunity to rebrand our currency, inspired by our company name, Anlatan, with the future in mind.
Anlas replaces NovelAI's Step currency.
One currency, used everywhere, introducing: Anlas.
With our unified currency, all subscription tiers will be able to use Anlas to access our image generation and its features.
We have also raised the default monthly amount of Anlas to 1000 for both Scroll and Tablet Subscriptions, allowing the use of the currency for Image Generation in addition to Custom AI Module training.
Please note that an active subscription is required to purchase Anlas.
With that out, let's get on to several features of our Image Generation!
We’ve increased the CLIP token context capabilities by three, from 77 token to 231 tokens, giving you more space to craft your prompt than ever. The Model has been trained without crops, which means now you can generate arbitrary aspect ratio images. Lastly we’ve greatly improved the language understanding of the CLIP model.
NovelAI Image Generation Settings at a glance
All subscribers will have access to image-to-image (img2img) features, in which you can tweak, modify, or even draw images from scratch and have the model generate from it as a base:
Upload Image allows you to do just that, upload any image file into the editor and direct the AI generation: Combine your uploaded Image with a corresponding text prompt so you can tweak appearances or even use it as a guide for color schemes or compositions.
Paint New Image opens the NovelAI Canvas, where you can draw a guide, concept, or even define a color scheme for the AI. Describe your desired outcome in the text prompt and generate!
From sketch & prompt to generation & a quick switch to open eyes!
Edit Image allows you to edit a previous generation or uploaded Image. Edit Image can be used to fix or modify anything that seems off or should be added to the final composition.
Enhance Image allows a second generation run through the model. alongside your text prompt to refine the generation of your choice further.
Generate Variations allows the option to create more variations of a specific generation if you'd like to explore more generations of a concept or general idea that the AI came up with.
Undesired Content gives you the power to banish unwanted generation visuals. For example: Tired of seeing girls? Banish them into the Undesired Content field in all their forms: 1girl, woman, female, and you should begin to see fewer of those quickly!
Strengthening & Weakening Vectors gives you control over the AI's finer focus during a generation by encasing the text you want to emphasize or deemphasize with { } for strength and [ ] for weakening. This works both inside the Text Prompt Field and Undesired Content Field.
You can read more on our documentation page: https://docs.novelai.net/
So, what happened to the delays?
We've heard your feedback on our delay announcement loud and clear.
Our users want an experience with unprecedented levels of unfiltered freedom, and so do we.
Therefore we have come to the decision to only offer our own unique models and forego the basic Standard Diffusion model, which is already offered in many other places and also would have required us to pay close attention to what kinds of content its different versions can produce. By offering our own exclusive experiences, we're able to provide you with a tool designed for visual storytelling without any limitations.
NovelAI is meant to be a storyteller, and we believe our Image Generation will allow you to paint all kinds of stories. We are only beginning to expand the capabilities of this feature. So, at this time, we no longer plan to provide the basic, standard Stable Diffusion model.
Please make sure to test and see if our NovelAI Diffusion model suits your needs.
Please keep in mind that the NovelAI Diffusion models will not produce the same results as the standard Stable Diffusion model, even with the same prompt and seed.
Copyright & Usage Rights
Images uploaded and generated on NovelAI are not stored on our servers. Make sure to regularly back up and save your images and text prompts.
We do not act as a platform to share images. Please use other services in order to share your generated images.
NovelAI does not claim copyright protections or ownership of any files. Images are treated as Content as defined in Section 1.4 in the Terms of Service. You must conduct your own research if you want to use your generated images for any settings outside NovelAI.
Make sure to save any Image Generations and Text Prompts you like! Text prompts, image generations, canvas edits, and image uploads are not stored and will be lost at the end of your session.
Please generate responsibly, and be mindful of your wordage. Image Generation is a new technology that may generate unpredictable results.
Feel free to tag us on social media, such as Twitter, and tag your generations with #NovelAI or #NAIDiffusion so we can follow the journey of your creations!
Want to add to the discussion?
Post a comment!