A LongCat video avatar is an audio-driven talking head. You supply a still portrait and a voice clip, and the model renders that face speaking the audio with matching lip movement — useful for faceless creators, virtual presenters and anyone who wants a recurring on-screen persona without a camera.
This page is about the local, self-managed Avatar workflow. The hosted generator on this site takes a still image plus a motion prompt and returns a clip: it does not accept audio and does not do speech-driven lip sync. If that is what you need, run Avatar-1.5 yourself with the steps below.
The avatar model is a distinct inference path, not a prompt trick on top of the base video model:
The practical rule: treat the avatar model and the base video model as two different tools that share a lineage. Swapping their checkpoints "because they are both LongCat" is the fastest way to a run that will not load.
| Version | Released | Audio encoder | Notes |
|---|---|---|---|
| LongCat-Video-Avatar | Dec 2025 | wav2vec2 | --model_type avatar-v1.0 (the default) |
| LongCat-Video-Avatar-1.5 | May 2026 | Whisper-Large-v3 | Better lip sync, 8-step distillation, 480P and 720P, optional INT8 |
Avatar 1.5 requires distillation sampling: if you run it without --use_distill, the run fails rather than silently falling back.
Upstream publishes the code, weights and commands; these are the steps from that repository, not a paraphrase of a video description.
git clone --single-branch --branch main https://github.com/meituan-longcat/LongCat-Video
cd LongCat-Video
conda create -n longcat-video python=3.10
conda activate longcat-video
# Install the PyTorch/CUDA combination for your machine, then:
pip install ninja psutil packaging
pip install flash_attn==2.7.4.post1
pip install -r requirements.txt
conda install -c conda-forge librosa ffmpeg
pip install -r requirements_avatar.txtpip install "huggingface_hub[cli]"
huggingface-cli download meituan-longcat/LongCat-Video-Avatar-1.5 \
--local-dir ./weights/LongCat-Video-Avatar-1.5Do not silently substitute the original Avatar checkpoint: the audio encoder and inference path differ between versions, and mixing files produces a checkpoint that will not load.
torchrun --nproc_per_node=2 run_demo_avatar_single_audio_to_video.py \
--context_parallel_size=2 \
--checkpoint_dir=./weights/LongCat-Video-Avatar-1.5 \
--stage_1=ai2v \
--input_json=assets/avatar/single_example_1.json \
--use_distill --model_type avatar-v1.5 --use_int8For two speakers, swap in run_demo_avatar_multi_audio_to_video.py with a multi-speaker JSON. For a longer clip, add the continuation flags:
--num_segments=5 --ref_img_index=10 --mask_frame_range=3These are the upstream tips, with the flags they map to:
| Setting | Value the repository recommends |
|---|---|
| Audio CFG | 3-5 works best; raise it for tighter lip sync |
--resolution | 480P or 720P |
--ref_img_index | Default 10; 0-24 keeps identity stable, 30 reduces repeated actions |
--mask_frame_range | Default 3; larger values suppress repetition but introduce artifacts if pushed |
audio_type=para (merge) | Two clips of equal length, summed |
audio_type=add (concatenation) | Any lengths; speech is concatenated with silence padding, first speaker first |
| Prompt length | Longer, more descriptive prompts beat short ones for consistency |
For a visual workflow, the community wrapper keeps LongCat nodes on its main branch:
cd ComfyUI/custom_nodes
git clone https://github.com/kijai/ComfyUI-WanVideoWrapper.git
cd ComfyUI-WanVideoWrapper
pip install -r requirements.txt
git rev-parse HEADRecord the commit printed by that last command with every saved workflow, then start from the repository's LongCatAvatar_audio_image_to_video_example_01.json example instead of an untraceable JSON from a video description. The wrapper is a personal, perpetually work-in-progress sandbox — update it in a separate copy, run one known input, and keep the last working commit so a node rename cannot break all jobs at once. There is no official Meituan ComfyUI node: the meituan-longcat organisation publishes the model, not a ComfyUI extension.
Bad inputs cause more avatar failures than weak hardware. Before you generate anything, satisfy this checklist:
The official Avatar 1.5 pages do not publish a universal "works on 8GB / 12GB" minimum. Community FP8, GGUF, CPU offload, block-swap and INT8 (the --use_int8 flag above) workflows can reduce peak VRAM, but the real number depends on checkpoint format, resolution, frame count, attention backend, system RAM, and wrapper version. Use a bounded test ladder:
"Supports long video" does not mean an infinite clip has zero drift. Continuation is a repeated generation operation — inspect every join for face changes, color shifts, hand artifacts, background jumps, and audio offset.
| Symptom | Likely boundary | First action |
|---|---|---|
| Nodes are missing | Wrapper install or stale node definitions | Restart ComfyUI and verify the pinned wrapper commit |
| Checkpoint will not load | Original Avatar and Avatar 1.5 files were mixed | Verify the exact model filename and upstream source |
| CUDA out of memory | Resolution, frames, model format, or insufficient offload | Reduce one dimension, shorten the clip, then measure again |
| Lips lag behind audio | Audio preprocessing, frame timing, or wrong encoder path | Test clean single-speaker audio on the official v1.5 example |
| Identity changes at joins | Continuation overlap or difficult source framing | Shorten the continuation and use a clearer reference image |
| First run works, update breaks | Moving community dependencies | Return to the recorded commit and upgrade in a separate copy |
The hosted generator on longcat-video.org is an image-to-video tool: a still image plus a motion prompt, priced at 150-300 credits per run depending on model and resolution, with the exact cost quoted before submission and purchased credits required from the first hosted run. It has no audio input, so it cannot produce a talking avatar.
It is an audio-driven talking head. You supply a still portrait and a voice clip, and the LongCat-Video-Avatar-1.5 model generates a video of that face speaking the audio with matching lip movement.
No. The generator on this site takes a still image and a motion prompt; it has no audio input and no lip-sync path. Audio-driven avatars need the local Avatar 1.5 setup described on this page.
LongCat-Video-Avatar-1.5. It uses a Whisper-Large-v3 audio encoder instead of the wav2vec2 encoder in the original Avatar model, and it requires distillation sampling: pass --use_distill --model_type avatar-v1.5, or the run fails instead of falling back.
A sharp portrait with the full head visible, one speaker, and a short clean WAV file with consistent sample rate and channel layout. Start single-speaker before attempting multi-person audio, and keep the same portrait when you compare settings.
There is no published universal minimum. FP8, GGUF, CPU offload, block-swap, and INT8 (--use_int8) reduce peak usage, but the real requirement depends on resolution, frames, checkpoint format, and the attention backend. Measure with a 3-5 second test instead of assuming a figure.
No. Continuation is a repeated generation operation, so inspect every join for face changes, color shifts, and audio offset. Increase duration only after lip sync and identity stay stable on shorter clips.
Use a local Avatar 1.5 environment for speech-driven lip sync. The hosted image-to-video tool animates a still image without audio input.