BlackForestLabs has exciting news to share. The company is expanding its FLUX.1 AI image platform with a powerful new suite of tools that takes everything to the next level.

## What's New in BlackForestLabs' FLUX.1 Family?

Building on the success of their FLUX.1 text-to-image model, BlackForestLabs has developed four new tools that give users even more creative control:

1. **FLUX.1 Fill** - An advanced addition to the FLUX.1 platform for smart image editing
2. **FLUX.1 Depth** - Their new 3D-aware image understanding system
3. **FLUX.1 Canny** - BlackForestLabs' edge-preservation technology
4. **FLUX.1 Redux** - A fresh way to remix and enhance FLUX.1 generations

Following BlackForestLabs' commitment to the community, they're releasing each tool in two flavors: open-access [dev] versions and professional [pro] versions through their BFL API.

## FLUX.1 Fill: Taking BlackForestLabs' Image Tech Further

BlackForestLabs built FLUX.1 Fill to complement their base FLUX.1 model perfectly. 

Here's what makes their latest tool special:
- Outperforms other solutions like Ideogram 2.0 (check out their benchmarks!)
- Seamlessly integrates with existing FLUX.1 generations
- Adds powerful outpainting capabilities to their FLUX.1 ecosystem

The benchmarks are in: BlackForestLabs' FLUX.1 Fill [pro] is leading the pack, with their [dev] version coming in strong second!
![flux-tools-inpaint.jpeg](https://api.comfyuiweb.com/uploads/flux_tools_inpaint_4b77a7e6fa.jpeg)
![flux-tools-outputpaint.jpeg](https://api.comfyuiweb.com/uploads/flux_tools_outputpaint_c7670df51e.jpeg)

## Structural Control with FLUX.1 Depth and Canny

These tools represent the next evolution of the FLUX.1 platform.

BlackForestLabs has developed two approaches to maintain precise control:

- **FLUX.1 Depth** adds 3D awareness to FLUX.1 generations
- **FLUX.1 Canny** preserves structural integrity during edits

Their team benchmarked these against competitors (including Midjourney ReTexture), and both tools showcase BlackForestLabs' leadership in AI image technology.

![flux-tools-depth.jpeg](https://api.comfyuiweb.com/uploads/flux_tools_depth_4821c51aed.jpeg)
![flux-tools-canny.jpeg](https://api.comfyuiweb.com/uploads/flux_tools_canny_4938fd3407.jpeg)

## FLUX.1 Redux: The Future of Image Generation

This tool takes everything great about FLUX.1 and adds new creative possibilities:
- Generate variations of any FLUX.1 output
- Mix FLUX.1 generations with new prompts
- Create high-resolution 4MP images
- Work with flexible aspect ratios

It's fully integrated with their latest FLUX1.1 [pro] Ultra model for the best possible results!
![flux-tools-remix1.jpeg](https://api.comfyuiweb.com/uploads/flux_tools_remix1_2ba0c1bbd7.jpeg)
![flux-tools-remix2.jpeg](https://api.comfyuiweb.com/uploads/flux_tools_remix2_bc37e2afbd.jpeg)

## FAQ

**Q: How does FLUX.1 Tools fit into the BlackForestLabs ecosystem?**
A: These tools are built specifically to enhance their FLUX.1 platform, giving users more control over generations.

**Q: Which tool works best with the base FLUX.1 model?**
A: FLUX.1 Fill integrates most naturally with existing FLUX.1 workflows.

**Q: Can I use these with existing FLUX.1 projects?**
A: Yes! All tools are designed to work seamlessly with FLUX.1 generations.

## Start Creating with BlackForestLabs' Complete FLUX.1 Suite

BlackForestLabs continues to expand the FLUX.1 platform with tools that serve both their open-source community and professional users. These additions represent their ongoing commitment to advancing AI image technology while keeping it accessible.

For a deep dive into how these tools enhance the FLUX.1 platform, visit [blackforestlabs.ai/flux-1-tools/](blackforestlabs.ai/flux-1-tools/)

You can also access the model on fal.ai, Replicate, Together.ai, Freepik and krea.ai.

🔥 BlackForestLabs Just Broke the AI Image Game - See The Tool That's Making Midjourney Sweat!

flux-tools-remix2.jpeg

BlackForestLabs' FLUX.1 Tools: A Game-Changing Update to Their AI Image Platform

Hey there! I've been testing out Recraft V3 for the past few weeks, and I gotta tell you - it's pretty amazing what this thing can do. Let me break it down for you.

## What's Recraft V3 All About?
![leaderboard.png](https://api.comfyuiweb.com/uploads/leaderboard_fc00b66a6f.png)
You know how creating custom images for your business can be a total pain? That's exactly what Recraft V3 fixes.

It's like having a super-smart design assistant that actually gets what you're trying to do. 

Here's what makes it different:
- It doesn't just generate random images - it actually understands text placement
- You can create unlimited designs (well, within your daily credits)
- It's way faster than other AI tools I've tried

The cool thing? More and more designers are switching to it. I've seen loads of posts on Twitter showing off what they've made with it.

## The Features That Actually Matter

### Text That Actually Looks Good
Remember when AI-generated text in images looked totally fake? Not anymore.

What I love about Recraft V3:
![recraftv3-example2.jpg](https://api.comfyuiweb.com/uploads/recraftv3_example2_fab1388421.jpg)
- You can add as much text as you want
- The text actually goes where you tell it to
- It doesn't do that weird AI thing where letters look like alien symbols

I tried making a social media post yesterday - took me literally 2 minutes to get the text placement perfect. That would've been at least 30 minutes in Photoshop.

### Making Things Look Exactly How You Want

The control you get with Recraft V3 is pretty wild:
- Want square images? Done
- Need something super wide for a banner? Easy
- Got specific brand colors? Just plug 'em in

It's like they actually asked designers what they needed instead of just guessing.

### Speed and Quality (Finally Together)

Look, I'm not gonna pretend every image comes out perfect. But here's what I've found:
- Most images take about 15 seconds to generate
- The quality is consistently good (not that hit-or-miss stuff you get with other tools)
- Details actually look realistic, not like some weird AI dream

## Using Recraft V3: The Simple Guide

I remember feeling pretty lost when I first opened Recraft V3. But trust me, it's way simpler than it looks.

Here's how I use it:
1. Type what you want (be specific but not too wordy)
2. Pick your size
3. Hit generate
4. Tweak if needed

That's literally it. No fancy stuff needed.

## The Real-World Stuff You Can Make

Let me share what I've actually used it for:
- Instagram posts that don't look AI-generated
- Quick logo concepts for clients
- Book covers that actually look professional
- Product mockups that saved me hours

## Tips That Actually Work

After messing around with it for weeks, here's what I've learned:
- Short, clear prompts work better than long ones
- Start simple, then add details
- If something looks off, regenerate instead of trying to fix it
- Use the edit tools for small tweaks only

## Why I Picked Recraft V3 Over Others

I've tried pretty much everything out there. Here's the real talk:
- MidJourney: Great but expensive
- DALL-E: Good but limited control
- Recraft V3: Best balance of control and cost

The free credits every 24 hours (50 of them) are usually enough for my daily needs.

## FAQs About Recraft V3

**Is Recraft V3 really free?**
Yep, you get 50 credits daily with the free version.

**Can I use these images commercially?**
Yes, but double-check their latest terms just to be safe.

**Do I need design experience?**
Nah, but it helps to know basic design principles.

**How does it compare to Photoshop?**
It's not a Photoshop replacement - think of it as a quick design generator.

## Final Thoughts

Look, Recraft V3 isn't perfect. But for quickly creating professional-looking images? It's pretty hard to beat.

My advice? Try the free version. Play around with it. See if it fits your workflow.

Just remember: it's a tool, not magic. But it's a pretty darn good tool.

Discover how Recraft V3 beats DALL-E & Midjourney at image generation. Get my exact prompts + see real results from 50 free daily credits 🎨

recraftv3-example.webp

Getting Started with Recraft V3: The AI Image Tool That's Actually Easy to Use



Hey there! 👋 

I just spent hours digging into the new IC-Light V2 updates, and wow - there's some cool stuff happening.

In this guide, I'll break down everything you need to know about this AI image model (in plain English, I promise).

Let's dive in.

## What's New in IC-Light V2?

You know how frustrating it is when AI messes up the details in your images?

Well, that's exactly what IC-Light V2 fixes.

Here's the deal:

* They've added a 16-channel VAE (fancy way of saying it keeps more detail)
* It handles high-res images way better than before
* You can actually keep your image style without the AI going crazy with changes

The best part? It's all built on something called Flux (more on that in a sec).

## The Real-World Performance

Look, I've tested a ton of AI image models.

And here's what makes IC-Light V2 different:
![ic-light-v2.jpg](https://api.comfyuiweb.com/uploads/ic_light_v2_3534302dd5.jpg)
1. **Detail preservation is insane**
   * Compared to SD1.5, it keeps way more of the original image intact
   * No more weird artifacts in faces
   * Textures actually look real
![ic-light-v1.jpg](https://api.comfyuiweb.com/uploads/ic_light_v1_eac7aff012.jpg)
2. **Style handling**
   * Remember how old models would completely change your art style?
   * This one actually respects your original style
   * Perfect for artists who want to keep their unique look

I tested it with some tricky images, and honestly? It's pretty impressive.

## License Stuff (Important!)

Here's something you need to know:

The new version has a non-commercial license. 

What does this mean for you?

* Can't use it to make money (by default)
* Need special permission for commercial stuff
* Perfect for personal projects though

Pro tip: If you need it for commercial use, there's a way to get permission. Just reach out to the team.

## What Users Are Saying

I've been following the GitHub discussion, and here's what people are loving:

"Finally, something that doesn't destroy my art style!" - Digital Artist

"The detail preservation is next level" - AI Developer

Common questions I'm seeing:

### FAQ

**Q: Can I use this for my art portfolio?**
A: Yes, as long as it's not for commercial purposes.

**Q: How does it compare to Stable Diffusion?**
A: Better detail preservation, more natural style handling.

**Q: Will there be a commercial version?**
A: Possibly - the team's considering options.

## What's Coming Next?

Based on the discussion, here's what's in the pipeline:

* More model variations
* Better foreground handling
* Possible commercial options

## Bottom Line

IC-Light V2 is a major step up from V1.

If you're into AI art and want better detail preservation, this is worth checking out.

Just remember the license limitations before diving in.

### Quick Tips for Getting Started

1. Start with high-res images
2. Test the style preservation
3. Join the community discussions

Related Resources:
[IC-Light GitHub Project](https://github.com/lllyasviel/IC-Light)
[IC-Light Demo](https://huggingface.co/spaces/lllyasviel/IC-Light)
[IC-LightV2 Discussion](https://github.com/lllyasviel/IC-Light/discussions/98)

Discover the groundbreaking features of IC-Light V2 in this complete guide! Learn how this AI image model enhances detail preservation, respects your unique style, and outperforms previous versions like Stable Diffusion.

ic-light-v2.jpg

IC-Light V2 Update: Game-Changing AI Detail You'll Love

Hey there! 👋 

I've spent countless hours training LoRA models, and lemme tell you - it's way simpler than most people make it sound. Today I'm gonna show you exactly how to train your own LoRA model using FLUX.1 and [Vast.ai](https://cloud.vast.ai/?ref_id=90893).

## Why Should You Care About FLUX.1?

FLUX.1 is blowing up right now, and for good reason.

Think of it as your creative Swiss Army knife - it can generate almost anything you throw at it. But here's the cool part: with LoRA training, you can teach it to be even better at specific things.

## Getting Your Dataset Ready

Here's the deal with datasets:

- You'll need at least 10-20 images
- Make sure you've got the rights to use these images

Pro tip: Don't just grab random images off Google. You might run into copyright issues. Use proper  databases or open-source collections.

## The Step-by-Step Training Process

### 1. Getting Your Hands on a GPU

Look, I'll be straight with you - you need some serious hardware for this.

Two main options:
- Rent from [Vast.ai](https://cloud.vast.ai/?ref_id=90893) (my go-to)
- Use your own setup if you've got a beefy GPU

What you need:
- RTX 3060, 3090 or 4090 (don't even bother with less)
- At least 8GB VRAM

Here's how to get started on [Vast.ai](https://cloud.vast.ai/?ref_id=90893):
1. Create an account
2. Pick a template with the right GPU
![1.png](https://api.comfyuiweb.com/uploads/1_73948ef891.png)
![2.png](https://api.comfyuiweb.com/uploads/2_37f715f137.png)
![3.png](https://api.comfyuiweb.com/uploads/3_b35a001a9b.png)
3. Fire up Jupyter Notebook and Comfyui
![4.png](https://api.comfyuiweb.com/uploads/4_589dec5422.png)
![5.png](https://api.comfyuiweb.com/uploads/5_1053646f79.png)
![6.png](https://api.comfyuiweb.com/uploads/6_d46036b364.png)
4. Download model on Jupyter Notebook
![7.png](https://api.comfyuiweb.com/uploads/7_f407fe3b6e.png)
![8.png](https://api.comfyuiweb.com/uploads/8_564659db4c.png)
![9.png](https://api.comfyuiweb.com/uploads/9_43b1d29981.png)
![10.png](https://api.comfyuiweb.com/uploads/10_0b178a32cb.png)

You can use below text to download the fp8 model.

```
!wget https://huggingface.co/XLabs-AI/flux-dev-fp8/resolve/main/flux-dev-fp8.safetensors -O /workspace/ComfyUI/models/unet
!wget https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp8_e4m3fn.safetensors -O /workspace/ComfyUI/models/clip
!wget https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/clip_l.safetensors -O /workspace/ComfyUI/models/clip
!wget https://huggingface.co/black-forest-labs/FLUX.1-dev/resolve/main/ae.safetensors -O /workspace/ComfyUI/models/vae
```

### 2. Prepping Your Images

Time to get organized:

1. Create a new folder, my folder named "m22"
2. Upload your images
3. (Optional)Create caption files (same name as image, but .txt)

Example:
```
m22/
  ├── m22_001.png
  ├── m22_001.txt
  ├── m22_002.png
  └── m22_002.txt
```
![11.png](https://api.comfyuiweb.com/uploads/11_1bef77567d.png)

### 3. The Training Part

This is where the magic happens. Here's my tried-and-tested setup:

You can load my workflow for lora training.

[workflow](https://api.comfyuiweb.com/uploads/flux_lora_trainer_vastai_31295a56d2.json)

![18.png](https://api.comfyuiweb.com/uploads/18_bdd01a14a8.png)

Then setup the lora training configuration.

![12.png](https://api.comfyuiweb.com/uploads/12_29101bfa62.png)
![13.png](https://api.comfyuiweb.com/uploads/13_9b956469a5.png)

You need to set the output location to "/workspace/ComfyUI/models/loras"

Then you can click the queue button to start training about 30 minutes.

After training done, You can see the results in the workflow.

### 4. Using the lora model

Once you're done training, you might want to use the lora model to generate the images you wanted.

You can use the below workflow to generate images using lora model.

[workflow](https://api.comfyuiweb.com/uploads/workflow_inference_59d8dd8490.json)

![17.png](https://api.comfyuiweb.com/uploads/17_e33b72cfe4.png)

## What to Expect from Your Results

I've trained dozens of these models, and here's what I've learned:

- First results might look weird - that's normal
- Play with your prompts
- The trigger word is super important
- Sometimes less training is more

## Quick Tips for Better Results

- Start with default settings
- Train for longer if results are blurry
- Use clear, consistent captions
- Keep your dataset focused

## FAQs

**Q: How long does training usually take?**
A: About 30 minutes-1 hour with a 4090.

**Q: Can I use fewer images?**
A: You can, but results won't be as good. 10-20 is the sweet spot for object and 30+ is great for style.

**Q: Do I need to use Vast.ai?**
A: Nope! Any GPU setup with enough VRAM works.

## Final Thoughts

Training a LoRA isn't rocket science - it just needs a bit of patience and the right setup.

Remember: Start small, experiment lots, and have fun with it!

Got questions? Hit me up in the email. I personally answer every single one.

support@comfyuiweb.com





Learn how to train your own LoRA model with FLUX.1 in this step-by-step guide. Perfect for beginners, includes GPU setup, dataset preparation, and expert tips. 

18.png

How to train flux lora using comfyui on vast.ai?

# Introduction to Pyramid Flow AI Video Model

Yo, have you heard about Pyramid Flow? It's this cool new AI video model that's causing a stir.

I've been playing around with it, and I gotta say, it's pretty slick.

The best part? It's open source. You can download it and run it on your own beefy hardware or private server.

No need to rely on cloud services or worry about usage limits.

Let's dive in and see what this bad boy can do.


# 1. Integration with Comfy UI
![videoframe_3141.jpg](https://api.comfyuiweb.com/uploads/videoframe_3141_0d28df0077.jpg)

So, Pyramid Flow plays nice with Comfy UI. That's a big deal.

Comfy UI's got these custom nodes for Pyramid Flow that make life easier.

I've been messing with the Comfy UI Pyramid Flow wrapper, and it's a game-changer.

Here's the deal:

- You get a visual interface for Pyramid Flow
- It's way easier to experiment with different settings
- You can chain Pyramid Flow with other AI models

It's like having a playground for AI video generation. Pretty sweet, right?

# 2. Installation Process
![videoframe_576.jpg](https://api.comfyuiweb.com/uploads/videoframe_576_690507655a.jpg)

Getting Pyramid Flow up and running is a breeze. Here's how I did it:

1. Used Comfy UI Manager (easiest way, hands down)
2. Installed requirements.txt and did some manual pip installs
3. Downloaded models from HuggingFace and dropped 'em in Comfy UI

The whole process took me about 15 minutes. Not bad at all.

Pro tip: Make sure you've got enough disk space. These models are chunky.

# 3. Custom Node Wrapper Features
![videoframe_6609.jpg](https://api.comfyuiweb.com/uploads/videoframe_6609_0c55a05816.jpg)

The custom node wrapper for Pyramid Flow is where the magic happens.

There's this "Download Pyramid Flow models" node that's a lifesaver.

I also found a Python script that makes downloading files a walk in the park.

Here's what I love about the wrapper:

- It's user-friendly
- You can tweak settings on the fly
- It integrates seamlessly with other Comfy UI nodes

It's like having a Swiss Army knife for AI video generation.

# 4. Running AI Video Models in Comfy UI

Alright, let's get to the good stuff. Running Pyramid Flow in Comfy UI is where things get exciting.

I've been playing with text-to-video and image-to-video examples. It's wild.

Here's what I've learned:

- Start with simple prompts and work your way up
- Adjust parameters gradually to see their impact
- Don't be afraid to experiment – you might stumble onto something cool

I had a blast trying different settings. It's like being a mad scientist, but with videos.

# 5. Performance and Results

So, how does Pyramid Flow stack up? Pretty darn well, if you ask me.

I've been testing all sorts of text prompts and settings. Here's the scoop:

- Simple scenes work best (for now)
- Nature and abstract concepts yield impressive results
- Human characters are still a bit... let's say "quirky"

Compared to the demo page, my results were hit or miss. But that's the fun part, right?

The quality of the generated videos is impressive, considering it's running locally.

If you're into AI and video generation, give Pyramid Flow a shot. You won't regret it.

github: [https://github.com/kijai/ComfyUI-PyramidFlowWrapper](https://github.com/kijai/ComfyUI-PyramidFlowWrapper)

model: [https://huggingface.co/rain1011/pyramid-flow-sd3/tree/main](https://huggingface.co/rain1011/pyramid-flow-sd3/tree/main)

more demos: [https://pyramid-flow.github.io/](https://pyramid-flow.github.io/)

# FAQs

Q: Can Pyramid Flow run on my laptop?

A: Depends on your specs, mate. You'll need a beefy GPU to get decent results.

Q: How long does it take to generate a video?

A: Varies wildly. Simple scenes might take a few minutes, complex ones could take hours.

Q: Is Pyramid Flow better than other AI video models?

A: It's got its strengths, but "better" is subjective. Give it a try and see for yourself!

Q: Can I use Pyramid Flow for commercial projects?

A: Check the license, buddy. As of now, it's for non-commercial use only.

Q: How often is Pyramid Flow updated?

A: The devs are pretty active. I'd say check for updates every couple of weeks.

Explore Pyramid Flow, the open-source AI video model. Learn how to install, run locally, and create stunning videos using Comfy UI. Dive into text-to-video and image-to-video examples, performance insights, and future updates.

videoframe_5622.jpg

ComfyUI-PyramidFlowWrapper Introduction


## What's ComfyUI-PuLID-Flux All About?

So you're curious about ComfyUI-PuLID-Flux, huh? Let me break it down for ya.

It's this cool thing that lets you use PuLID-Flux models in ComfyUI to make and tweak images. 

Pretty neat, right?

I stumbled across it the other day and thought, "Wow, this could be a game-changer!"

Here's the deal:
- It's built on top of ComfyUI
- You can use PuLID-Flux models
- It's all about generating and editing images

The folks behind it keep updating it too. 

Like, in version 0.1.0, they added these work nodes with weight support and start/end positions. 

But heads up - attention masks aren't working yet. They're still tinkering with that.

I gotta say, it's pretty exciting to see how it's evolving. 

Every update feels like Christmas morning for us image generation nerds!

### FAQ: What can I do with ComfyUI-PuLID-Flux?

You can do all sorts of cool stuff:
- Generate images using PuLID-Flux models
- Edit existing images
- Play around with different model settings

It's like having a digital art studio right at your fingertips!

## Getting Started: What You Need to Know

Okay, let's talk about the nitty-gritty of using this bad boy.

First up, you gotta pick your Flux model. 

They've got a few options:

1. 32-bit/16-bit versions (these are hungry beasts - they'll gobble up about 22GB of VRAM)
2. 8-bit GGUF versions (bit lighter, only needs about 12GB VRAM)
3. 8-bit FP8 versions (also around 12GB VRAM)

I've tried 'em all, and honestly, they each have their quirks.

The 32-bit ones are like the Rolls-Royce of the bunch - smooth and powerful, but man, do they eat up memory!

The 8-bit versions are more like zippy little sports cars. They get the job done and don't hog all your resources.

Now, here's the kicker - you need more than just the Flux model. 

You gotta have:
- CLIP
- VAE
- EVA CLIP model
- PuLID Flux pre-trained model
- facexlib model
- InsightFace model

Sounds like a lot, right? Don't worry, I'll walk you through it.

### How to Get Everything Set Up

1. First things first, clone the repo into your ComfyUI/custom_nodes folder.

2. Install all the packages listed in requirements.txt. 

   Pro tip: Use a virtual environment if you're feeling fancy.

3. Download the Flux.1-dev model files. 
   - Stick the model in ComfyUI/models/unet
   - CLIP and encoder go in ComfyUI/models/clip
   - VAE goes in ComfyUI/models/vae

4. Grab the PuLID Flux pre-trained model and pop it in ComfyUI/models/pulid/.

5. Don't forget the EVA-CLIP model (EVA02-CLIP-L-14-336). That one goes in ComfyUI/models/clip.

6. Install facexlib. Don't sweat the model - it'll download itself when you first use it.

7. Last but not least, install InsightFace and unzip the AntelopeV2 model into ComfyUI/models/insightface/models/antelopev2.

Phew! That's a lot, but trust me, it's worth it.

### FAQ: Do I really need all these models?

Yep, you do. Each one plays a part in the image generation process. It's like a band - take out one instrument, and the whole sound changes.

## Heads Up: Known Issues

Alright, let's talk about some of the quirks you might run into.

First off, if your hardware's CUDA compute capability is below 8.0, you're gonna have a bad time with the ApplyPulidFlux node. 

Especially if you're using the Flux FP8 model - that bad boy needs bfloat16 support.

Here's a weird one: even if you disconnect the ApplyPulidFlux node after running it once, it'll still affect the Flux model. 

Kinda like that one friend who shows up uninvited to parties - always making an impact, even when they're not supposed to be there.

Oh, and the attention mask feature? Yeah, that's still in the works. So don't get your hopes up for that just yet.

But hey, that's the fun of cutting-edge tech, right? Always something new to look forward to!

### FAQ: Will these issues be fixed soon?

The devs are working on it, but no promises on when. These things take time, ya know?

## Wrapping It Up

So there you have it - ComfyUI-PuLID-Flux in a nutshell.

It's a powerful tool, but it's got its quirks.

If you're into image generation and don't mind a bit of tinkering, give it a shot.

Who knows? You might just create the next digital masterpiece!

Remember, the tech world moves fast. By the time you read this, there might be new updates or changes.

Always check the official repo for the latest info.

Happy generating, folks!

source: [https://github.com/balazik/ComfyUI-PuLID-Flux](https://github.com/balazik/ComfyUI-PuLID-Flux)

Discover ComfyUI-PuLID-Flux, a powerful tool for image generation in ComfyUI using the PuLID-Flux model. 

pulid_flux_einstein-min.png

ComfyUI-PuLID-Flux Guide


Hey there! Feeling lost in the world of ComfyUI? Don't sweat it. I've been there, and I'm here to break it down for you.

## What's the Deal with UNETs?

UNETs are like the brain of ComfyUI. They're the main model that makes the magic happen.

Think of a UNET as a super-smart artist. You give it an idea, and it paints a picture for you. But instead of using brushes, it uses math. Crazy, right?

Here's the cool part: UNETs are really good at learning from just a few examples. It's like they have a photographic memory for art styles.

The shape of a UNET looks kinda like a "U" (shocker, I know). This shape helps it remember both the big picture and the tiny details when it's creating an image.

## VAEs: The Image Compressors

VAE stands for Variational AutoEncoder. But forget that mouthful - let's call 'em image squishers.

These guys take your big, detailed image and squish it down into something called a "latent space". It's like taking a big, juicy burger and smooshing it into a tiny slider.

Here's the thing: this squishing process isn't perfect. You might lose a pickle or two along the way. That's why we say it's "lossy".

Pro tip: Don't keep switching between big images and squished ones. It's like repeatedly smooshing and un-smooshing that burger. Messy and not great for quality.

## CLIP: Your Text-to-Image Translator

CLIP is like that friend who's really good at describing things. You tell CLIP what you want, and it turns your words into something the UNET can understand.

Here's a neat trick: the words at the start of your prompt carry more weight. So if you really want a red scarf in your image, put "red scarf" right at the beginning.

You can even adjust how much CLIP listens to each part of your prompt. It's like turning up the volume on certain words.

## Tensors: The Building Blocks

Okay, this might sound a bit techy, but stay with me. Tensors are just a fancy way of saying "a bunch of numbers arranged in a specific way".

In ComfyUI, almost everything is a tensor. Images, prompts, you name it.

Want to see what a tensor looks like? Use the Tensor Shape Debug tool. It'll show you something like [[1,768,512,3]]. Don't panic! That's just telling you about the size and shape of your image.

Alright, let's dive deeper into some more ComfyUI basics. Buckle up!

## Checkpoints: The All-in-One Package

Ever ordered a combo meal? That's kinda what a checkpoint is in ComfyUI. It's got your UNET, CLIP, and VAE all bundled up nice and neat.

Think of it like this: You've got your burger (UNET), your fries (CLIP), and your drink (VAE) all in one convenient package. Yum!

But here's the cool part - you don't always have to eat everything together. ComfyUI lets you use loader nodes to grab just the bits you want. It's like being able to order just the fries if that's all you're craving.

## Latent Space: The Shrink Ray

Okay, picture this. You've got a massive, detailed photo of your dog. Latent space is like zapping that photo with a shrink ray. You end up with a tiny version that still kinda looks like your dog, but maybe his ears are a bit wonky.

This shrinking process is done by our pal VAE (remember the image squisher?). It's not perfect - you might lose some details, like the exact pattern of spots on your dog's nose.

Here's a pro tip: When you're working with images in ComfyUI, try to use sizes that divide evenly by 8. Why? Well, when the VAE does its shrinking thing, it divides everything by 8. If your numbers don't play nice with 8, you might end up with some funky results.

## Prompt Conditioning: Mixing Your Image Cocktail

Alright, let's talk about prompt conditioning. It's like being a bartender, but instead of mixing drinks, you're mixing ideas for your image.

You've got three main ways to mix:

1. Concat (short for concatenate): This is like layering your drinks. One idea goes in, then the next, no mixing.
2. Combine: This is more like making separate mini-cocktails and then pouring them together.
3. Average: Imagine taking all your ingredients, blending them up, and pouring out one smooth drink.

Each method gives you a different flavor in your final image. Play around and see what you like best!

## Conditioning Timestamp Range: The Time Traveler's Tool

This one's pretty wild. Imagine you could control when different parts of your prompt kick in during the image creation process.

Let's say you want to make a picture of a village that changes from spring to winter. You could tell ComfyUI, "Hey, use the 'spring village' prompt for the first 20% of the creation process, then switch to 'winter village' for the rest."

It's like being a time traveler and a weather controller all at once. Pretty neat, huh?

## Model Training Resolution: Size Matters

Different AI models are like different TV sets - they're made to work best at certain sizes.

Take SDXL, for example. It's like a fancy 4K TV - it's trained to work best with images that are 1024x1024 pixels. Using it for smaller images is like watching old VHS tapes on your new TV - it'll work, but it might not look as good as it could.

Want to test out different options? Set your seed value to 0. It's like hitting the shuffle button on your music player - you'll get a random mix each time.

## Samplers and Schedulers: The Dynamic Duo

Samplers and schedulers are like the conductor and musicians in an orchestra. They work together to create your final image.

There's no "best" sampler or scheduler - it depends on what kind of music (or in our case, image) you want to make. But Karras is pretty popular, like that one hit song everyone seems to know.

Samplers come in two flavors:
1. Predictable ones (like euler, dpmpp_2m, ddim, uni_pc): These are like classical music - structured and consistent.
2. Stochastic ones: These are more like jazz - a bit more random and unpredictable. Great if you want your images to have a bit more "oomph".

If you're just starting out, try these:
- Schedulers: karras, exponential, sgm_uniform, normal
- Samplers: euler, dpmpp_2m, uni_pc, dmpp_2m_sde_ddpm, dpm_adaptive

Mix and match to find your perfect combo!

## Steps: The Patience Game

Steps in ComfyUI are all about quality vs. speed. More steps? Better quality, but slower creation. Fewer steps? Faster, but might look a bit rough.

It's like cooking a stew. Sure, you could eat it after 10 minutes, but let it simmer for an hour and oh boy, that's where the magic happens!

Remember, ComfyUI isn't really "creating" images from scratch. It's more like it's chipping away at a block of noise, slowly revealing the image hidden inside. Just like Michelangelo said about his sculptures - the image is already there, ComfyUI just removes the extra bits!

## CFG: The Backseat Driver

CFG (or Classifier-Free Guidance) is like a backseat driver for your AI. A high CFG value is like having a really bossy navigator - the AI will follow your prompt to the letter. Low CFG? That's more like a chill friend who's happy to take the scenic route.

High CFG: "Turn left NOW! No, your OTHER left!"
Low CFG: "Eh, whatever looks good to you, man."

Use high CFG when you need something specific, like a product image. Go low when you want to see what crazy ideas the AI comes up with!

## Random Seed: The Magic Number

The random seed is like the secret code that unlocks a specific image. Use the same seed, prompt, and settings, and you'll get the same image every time.

It's super useful for tweaking your creations. Found something you like but want to change just one thing? Keep the seed the same and you can make small adjustments without losing the overall vibe.

Phew! That's a lot of ComfyUI basics to take in. But don't worry if it all doesn't click right away. The best way to learn is to jump in and start playing around. Before you know it, you'll be creating amazing images and wondering how you ever lived without ComfyUI!

## FAQs

Q: Do I need to understand all this to use ComfyUI?
A: Nah, but it helps! Start playing around, and you'll pick it up as you go.

Q: What's the best sampler to use?
A: There's no "best" - it depends on what you're after. But Karras is pretty popular.

Q: How many steps should I use?
A: More steps = better quality, but slower. Start with 20 and adjust from there.

Remember, ComfyUI basics are just the start. The real fun begins when you start experimenting! So go on, give it a shot. You might surprise yourself with what you create.

You can provide us with any feedback at our email: support@comfyuiweb.com

Dive into ComfyUI basics with this straightforward guide. Learn about UNETs, VAEs, and more without the tech jargon. Perfect for AI image generation newbies!

comfyui-basics.jpg

ComfyUI Basics: A Simple Guide for Beginners

Wanna use Luma AI's cool video stuff in ComfyUI? You're in the right spot. I'll break it down for ya.

## What's ComfyUI-LumaAI-API?

It's this neat custom node thing. Lets you use Luma AI API right in ComfyUI to make videos with their Dream Machine AI model.

You can find it here: https://github.com/lumalabs/ComfyUI-LumaAI-API

## Getting Ready

Before you dive in, you'll need:

* A Luma AI API key
* Somewhere to host your images (they say ImgBB's good)

## Setting It Up

Got a few ways to do this:

### 1. The Manual Way

1. Go to your ComfyUI/custom_nodes folder
2. Clone this: 
   ```
   git clone https://github.com/lumalabs/ComfyUI-LumaAI-API.git
   ```
3. Install the stuff it needs:
   * On Windows (ComfyUI portable):
     ```
     .\python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-LumaAI-API\requirements.txt
     ```
   * On Linux or Mac:
     ```
     cd ComfyUI-LumaAI-API && pip install -r requirements.txt
     ```

If you want, you can add your Luma API key to the config.ini file. Keeps it safe.

### 2. Using ComfyUI-Manager

1. Open ComfyUI-Manager
2. Find and install the LumaAI API node (ComfyUI-LumaAI-API)

### 3. Comfy Registry Way

Just run this:
```
comfy node registry-install comfyui-lumaai-api
```

## The Nodes You Get

* LumaAIClient: Sets up the Luma AI connection
* LumaText2Video: Makes videos from text
* LumaImage2Video: Turns images into videos
* LumaInterpolateGenerations: Blends two videos
* LumaExtendGeneration: Makes videos longer
* LumaPreviewVideo: Shows you the video (768px size for ComfyUI)
* ImgBBUpload: Puts your image on ImgBB and gives you the link

## Wanna See How It Works?

Check out the example workflows in the GitHub repo. Just download the JSON files and load 'em into ComfyUI.

## More Stuff to Know

* Luma AI API docs: https://lumalabs.ai/dream-machine/api
* How much it costs: https://luma-ai.com/pricing/

## Questions People Ask

1. What's this Luma AI Dream Machine API?
   It's Luma's video-making API based on their Dream Machine model.

2. What do I need to use it?
   A Luma AI API key, ComfyUI, and the ComfyUI-LumaAI-API custom node.

3. How do I get the ComfyUI-LumaAI-API node?
   You can install it manually, use ComfyUI-Manager, or use Comfy Registry.

4. What can I do with these nodes?
   Make videos from text or images, blend videos, make them longer, and more.

5. Got any examples?
   Yep, check the workflows folder in the GitHub repo.

6. Where can I learn more about the Luma AI API?
   Their API docs have all the details.

7. How much does it cost?
   Check their pricing page for the latest info.

That's the basics! Give it a shot and see what cool stuff you can make. If you get stuck, the GitHub page is a good place to look for help.

Learn how to create stunning videos effortlessly. Our guide shows you how to integrate, install, and use Luma AI Dream Machine API in ComfyUI. Transform your video creation process today!

ComfyUI-LumaAI- API.jpg

 ComfyUI Luma AI API: A Simple Guide

Hey there! 

Ever wanted to create videos just by describing them? 

That's exactly what ComfyUI-CogVideoXWrapper lets you do. 

Let's dive in and see what this cool tool is all about.

## What's ComfyUI-CogVideoXWrapper?

ComfyUI-CogVideoXWrapper is a nifty add-on for ComfyUI that brings the power of CogVideoX models to your fingertips. 

In simple terms, it's a tool that can turn your words into moving pictures. Pretty wild, right?

The whole thing is still a work in progress, but it's already got some awesome features. 

Let's check 'em out.

## The Cool Stuff It Can Do

### Text to Video Magic
![cogvideo-x-5b.jpg](https://api.comfyuiweb.com/uploads/cogvideo_x_5b_cc1f7cb6ec.jpg)

Got a scene in your head? Just describe it, and ComfyUI-CogVideoXWrapper will try to bring it to life.

It uses something called the CogVideoX-5b model. Don't worry about the name - just know it's pretty good at understanding your descriptions and turning them into short videos.

### Image to Video Wizardry
![cog-video-x-1.jpg](https://api.comfyuiweb.com/uploads/cog_video_x_1_dfca5341d7.jpg)

Have a cool image you want to animate? ComfyUI-CogVideoXWrapper can help with that too.

It takes your starting image and creates a video based on it. Think of it like giving your pictures superpowers to start moving.

### Endless Video Loops

Ever wanted a video that just keeps going? ComfyUI-CogVideoXWrapper has a trick called "time tiling" that can create seamless, looping videos.

It's perfect for those hypnotic, repeating backgrounds or just for fun experiments.

## What's New and Exciting?

The folks behind ComfyUI-CogVideoXWrapper keep making it better. Here are some of the latest updates:

1. They've added support for the official CogVideoX I2V (Image to Video) version. If you want to try it, make sure you've got diffusers version 0.30.3 installed.

2. There's now experimental support for something called "onediff". It can make the whole process about 40% faster! But it's a bit tricky to set up, so maybe wait on this one unless you're feeling adventurous.

3. They've also added support for the CogVideoX-Fun model. It's not an official Image to Video model, but it can still do some cool stuff.

## How Much Computer Power Do You Need?

Let's be real - this tool is pretty demanding on your computer. You'll need a beefy graphics card with at least 13-14GB of VRAM for the best results.

Don't worry if that sounds like gibberish. Just know that you might need a pretty powerful computer to run this smoothly.

## Want to Give It a Try?

If you're itching to play with ComfyUI-CogVideoXWrapper, here's what you need to know:

1. You'll need to have ComfyUI installed first.
2. Make sure you've got diffusers version 0.30.1 or newer.
3. Follow the installation instructions on the GitHub page (I'll link it at the end).

Remember, this is still a work in progress. Expect some bumps along the way, but that's part of the fun of trying cutting-edge tech!

## Frequently Asked Questions

1. Can I use ComfyUI-CogVideoXWrapper to edit existing videos?
   Not directly, but you can use the "image to video" feature to create new videos based on frames from existing ones.

2. How long can the videos be?
   It depends on your computer's power and your settings. You can use the "time tiling" feature to create longer, looping videos.

3. Is ComfyUI-CogVideoXWrapper free to use?
   Yes, it's open-source and free to use. But if you find it helpful, consider supporting the developers!

4. Can I use ComfyUI-CogVideoXWrapper for commercial projects?
   Check the license on the GitHub page to be sure, but generally, open-source tools like this can be used for commercial projects.

5. How often is ComfyUI-CogVideoXWrapper updated?
   The developers seem pretty active, with regular updates and new features being added.

## Wrapping Up

ComfyUI-CogVideoXWrapper is a super cool tool that lets you create videos from text or images. It's still being worked on, but it's already capable of some amazing stuff.

If you're into AI, video creation, or just love playing with new tech, it's definitely worth checking out. Just remember, you'll need a pretty powerful computer to get the most out of it.

Want to learn more or give it a try? Head over to the [ComfyUI-CogVideoXWrapper GitHub page](https://github.com/kijai/ComfyUI-CogVideoXWrapper) for all the details and installation instructions.

Have fun creating some awesome videos!

github: https://github.com/kijai/ComfyUI-CogVideoXWrapper

ComfyUI-CogVideoXWrapper is a tool that allows you to use CogVideoX models within ComfyUI. ComfyUI-CogVideoXWrapper supports the following CogVideoX models: CogVideoX-5b, CogVideoX-Fun, CogVideoX-5b-I2V

Latest News for ComfyUI