ComfyUI-PuLID-Flux Guide

Posted on October 12, 2024 - Nodes

What's ComfyUI-PuLID-Flux All About?

So you're curious about ComfyUI-PuLID-Flux, huh? Let me break it down for ya.

It's this cool thing that lets you use PuLID-Flux models in ComfyUI to make and tweak images.

Pretty neat, right?

I stumbled across it the other day and thought, "Wow, this could be a game-changer!"

Here's the deal:

  • It's built on top of ComfyUI
  • You can use PuLID-Flux models
  • It's all about generating and editing images

The folks behind it keep updating it too.

Like, in version 0.1.0, they added these work nodes with weight support and start/end positions.

But heads up - attention masks aren't working yet. They're still tinkering with that.

I gotta say, it's pretty exciting to see how it's evolving.

Every update feels like Christmas morning for us image generation nerds!

FAQ: What can I do with ComfyUI-PuLID-Flux?

You can do all sorts of cool stuff:

  • Generate images using PuLID-Flux models
  • Edit existing images
  • Play around with different model settings

It's like having a digital art studio right at your fingertips!

Getting Started: What You Need to Know

Okay, let's talk about the nitty-gritty of using this bad boy.

First up, you gotta pick your Flux model.

They've got a few options:

  1. 32-bit/16-bit versions (these are hungry beasts - they'll gobble up about 22GB of VRAM)
  2. 8-bit GGUF versions (bit lighter, only needs about 12GB VRAM)
  3. 8-bit FP8 versions (also around 12GB VRAM)

I've tried 'em all, and honestly, they each have their quirks.

The 32-bit ones are like the Rolls-Royce of the bunch - smooth and powerful, but man, do they eat up memory!

The 8-bit versions are more like zippy little sports cars. They get the job done and don't hog all your resources.

Now, here's the kicker - you need more than just the Flux model.

You gotta have:

  • CLIP
  • VAE
  • EVA CLIP model
  • PuLID Flux pre-trained model
  • facexlib model
  • InsightFace model

Sounds like a lot, right? Don't worry, I'll walk you through it.

How to Get Everything Set Up

  1. First things first, clone the repo into your ComfyUI/custom_nodes folder.

  2. Install all the packages listed in requirements.txt.

    Pro tip: Use a virtual environment if you're feeling fancy.

  3. Download the Flux.1-dev model files.

    • Stick the model in ComfyUI/models/unet
    • CLIP and encoder go in ComfyUI/models/clip
    • VAE goes in ComfyUI/models/vae

  4. Grab the PuLID Flux pre-trained model and pop it in ComfyUI/models/pulid/.

  5. Don't forget the EVA-CLIP model (EVA02-CLIP-L-14-336). That one goes in ComfyUI/models/clip.

  6. Install facexlib. Don't sweat the model - it'll download itself when you first use it.

  7. Last but not least, install InsightFace and unzip the AntelopeV2 model into ComfyUI/models/insightface/models/antelopev2.

Phew! That's a lot, but trust me, it's worth it.

FAQ: Do I really need all these models?

Yep, you do. Each one plays a part in the image generation process. It's like a band - take out one instrument, and the whole sound changes.

Heads Up: Known Issues

Alright, let's talk about some of the quirks you might run into.

First off, if your hardware's CUDA compute capability is below 8.0, you're gonna have a bad time with the ApplyPulidFlux node.

Especially if you're using the Flux FP8 model - that bad boy needs bfloat16 support.

Here's a weird one: even if you disconnect the ApplyPulidFlux node after running it once, it'll still affect the Flux model.

Kinda like that one friend who shows up uninvited to parties - always making an impact, even when they're not supposed to be there.

Oh, and the attention mask feature? Yeah, that's still in the works. So don't get your hopes up for that just yet.

But hey, that's the fun of cutting-edge tech, right? Always something new to look forward to!

FAQ: Will these issues be fixed soon?

The devs are working on it, but no promises on when. These things take time, ya know?

Wrapping It Up

So there you have it - ComfyUI-PuLID-Flux in a nutshell.

It's a powerful tool, but it's got its quirks.

If you're into image generation and don't mind a bit of tinkering, give it a shot.

Who knows? You might just create the next digital masterpiece!

Remember, the tech world moves fast. By the time you read this, there might be new updates or changes.

Always check the official repo for the latest info.

Happy generating, folks!

source: https://github.com/balazik/ComfyUI-PuLID-Flux