ComfyUI Luma AI API: A Simple Guide

Wanna use Luma AI's cool video stuff in ComfyUI? You're in the right spot. I'll break it down for ya.

What's ComfyUI-LumaAI-API?

It's this neat custom node thing. Lets you use Luma AI API right in ComfyUI to make videos with their Dream Machine AI model.

You can find it here: https://github.com/lumalabs/ComfyUI-LumaAI-API

Getting Ready

Before you dive in, you'll need:

• A Luma AI API key
• Somewhere to host your images (they say ImgBB's good)

Setting It Up

Got a few ways to do this:

1. The Manual Way

1. Go to your ComfyUI/custom_nodes folder
2. Clone this:

   git clone https://github.com/lumalabs/ComfyUI-LumaAI-API.git
   

3. Install the stuff it needs:
   • On Windows (ComfyUI portable):

     .\python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-LumaAI-API\requirements.txt
     

   • On Linux or Mac:

     cd ComfyUI-LumaAI-API && pip install -r requirements.txt
     

If you want, you can add your Luma API key to the config.ini file. Keeps it safe.

2. Using ComfyUI-Manager

1. Open ComfyUI-Manager
2. Find and install the LumaAI API node (ComfyUI-LumaAI-API)

3. Comfy Registry Way

Just run this:

comfy node registry-install comfyui-lumaai-api

The Nodes You Get

• LumaAIClient: Sets up the Luma AI connection
• LumaText2Video: Makes videos from text
• LumaImage2Video: Turns images into videos
• LumaInterpolateGenerations: Blends two videos
• LumaExtendGeneration: Makes videos longer
• LumaPreviewVideo: Shows you the video (768px size for ComfyUI)
• ImgBBUpload: Puts your image on ImgBB and gives you the link

Wanna See How It Works?

Check out the example workflows in the GitHub repo. Just download the JSON files and load 'em into ComfyUI.

More Stuff to Know

• Luma AI API docs: https://lumalabs.ai/dream-machine/api
• How much it costs: https://luma-ai.com/pricing/

Questions People Ask

1. What's this Luma AI Dream Machine API? It's Luma's video-making API based on their Dream Machine model.

2. What do I need to use it? A Luma AI API key, ComfyUI, and the ComfyUI-LumaAI-API custom node.

3. How do I get the ComfyUI-LumaAI-API node? You can install it manually, use ComfyUI-Manager, or use Comfy Registry.

4. What can I do with these nodes? Make videos from text or images, blend videos, make them longer, and more.

5. Got any examples? Yep, check the workflows folder in the GitHub repo.

6. Where can I learn more about the Luma AI API? Their API docs have all the details.

7. How much does it cost? Check their pricing page for the latest info.

That's the basics! Give it a shot and see what cool stuff you can make. If you get stuck, the GitHub page is a good place to look for help.