Local video generation: ComfyUI and LTX-2.3

Previously, creating videos using neural networks was the prerogative of cloud services like Runway or Luma. Today, if you have a modern Nvidia graphics card, you can generate high-quality videos right on your computer. In this post, I will tell you how to set up local video generation using ComfyUI and the effective LTX-2.3 model.

Tools for video generation

For work we will need:
ComfyUI: a powerful interface with a node-based architecture that allows you to flexibly customize the generation process.
LTX-2.3: A modern model from Lightricks, optimized for creating smooth and detailed videos with relatively moderate video memory requirements.

Hardware requirements

Generating video is a much more resource-intensive process than working with images:
Video card (GPU): Nvidia RTX with 8 GB VRAM is the minimum required for a resolution of 768×512. For comfortable operation and higher resolutions, it is highly desirable to have 16–24 GB of VRAM.
Random access memory (RAM): minimum 32 GB. Video models and VAEs take up a lot of space when downloading.
Disk space: about 500 GB for the model itself and related components.

Setup and launch

The process of launching LTX-2.3 in ComfyUI is as follows:
1. Update ComfyUI: The model is relatively new, so make sure you have the latest version of the interface installed.
2. Install Workflow: The easiest way is to find a ready-made JSON template for LTX Video. The model requires specific nodes to work with video latent space.
3. Prompt and parameters: Enter a description of the scene in English. Note that the LTX-2.3 understands motion well (eg “camera orbits around”, “fast movement”).

Why choose LTX-2.3?

LTX-2.3 is notable because it delivers results comparable to proprietary cloud services, but runs locally. This gives you:
Complete privacy: your prompts and generated videos do not go to other people’s servers.
Control: you can experiment with frame rate (FPS), resolution and prompt strength without having to pay for each attempt.

Local video generation is still in active development, and LTX-2.3 is a great entry into the world of “home Hollywood.”

Links

https://github.com/comfyanonymous/ComfyUI
https://huggingface.co/Lightricks/LTX-Video