LongCat Video Avatar 1.5 Setup: Commands & VRAM

Run LongCat-Video-Avatar 1.5 locally: exact commands, an input checklist and VRAM numbers — and why the hosted tool is image-to-video, not lip-sync.

A LongCat video avatar is an audio-driven talking head. You supply a still portrait and a voice clip, and the model renders that face speaking the audio with matching lip movement — useful for faceless creators, virtual presenters and anyone who wants a recurring on-screen persona without a camera.

This page is about the local, self-managed Avatar workflow. The hosted generator on this site takes a still image plus a motion prompt and returns a clip: it does not accept audio and does not do speech-driven lip sync. If that is what you need, run Avatar-1.5 yourself with the steps below.

What "avatar" means in the LongCat ecosystem

The avatar model is a distinct inference path, not a prompt trick on top of the base video model:

  • Audio-driven generation — a portrait plus a WAV file in, a speaking head out, with lip movement produced by the audio encoder rather than a retiming pass after generation
  • A separate checkpoint — LongCat-Video-Avatar-1.5 — whose audio encoder differs from the standard LongCat Video model
  • Single- and multi-speaker input — v1.5 accepts one audio stream or two
  • Continuation — the same model extends a shot, so long clips are repeated generations stitched in place

The practical rule: treat the avatar model and the base video model as two different tools that share a lineage. Swapping their checkpoints "because they are both LongCat" is the fastest way to a run that will not load.

Avatar 1.0 vs Avatar 1.5

VersionReleasedAudio encoderNotes
LongCat-Video-AvatarDec 2025wav2vec2--model_type avatar-v1.0 (the default)
LongCat-Video-Avatar-1.5May 2026Whisper-Large-v3Better lip sync, 8-step distillation, 480P and 720P, optional INT8

Avatar 1.5 requires distillation sampling: if you run it without --use_distill, the run fails rather than silently falling back.

How to run it: the official path

Upstream publishes the code, weights and commands; these are the steps from that repository, not a paraphrase of a video description.

1. Install the environment

git clone --single-branch --branch main https://github.com/meituan-longcat/LongCat-Video
cd LongCat-Video

conda create -n longcat-video python=3.10
conda activate longcat-video

# Install the PyTorch/CUDA combination for your machine, then:
pip install ninja psutil packaging
pip install flash_attn==2.7.4.post1
pip install -r requirements.txt
conda install -c conda-forge librosa ffmpeg
pip install -r requirements_avatar.txt

2. Download the Avatar 1.5 weights

pip install "huggingface_hub[cli]"
huggingface-cli download meituan-longcat/LongCat-Video-Avatar-1.5 \
  --local-dir ./weights/LongCat-Video-Avatar-1.5

Do not silently substitute the original Avatar checkpoint: the audio encoder and inference path differ between versions, and mixing files produces a checkpoint that will not load.

3. Run an audio image-to-video job

torchrun --nproc_per_node=2 run_demo_avatar_single_audio_to_video.py \
  --context_parallel_size=2 \
  --checkpoint_dir=./weights/LongCat-Video-Avatar-1.5 \
  --stage_1=ai2v \
  --input_json=assets/avatar/single_example_1.json \
  --use_distill --model_type avatar-v1.5 --use_int8

For two speakers, swap in run_demo_avatar_multi_audio_to_video.py with a multi-speaker JSON. For a longer clip, add the continuation flags:

  --num_segments=5 --ref_img_index=10 --mask_frame_range=3

4. Settings that change the output

These are the upstream tips, with the flags they map to:

SettingValue the repository recommends
Audio CFG3-5 works best; raise it for tighter lip sync
--resolution480P or 720P
--ref_img_indexDefault 10; 0-24 keeps identity stable, 30 reduces repeated actions
--mask_frame_rangeDefault 3; larger values suppress repetition but introduce artifacts if pushed
audio_type=para (merge)Two clips of equal length, summed
audio_type=add (concatenation)Any lengths; speech is concatenated with silence padding, first speaker first
Prompt lengthLonger, more descriptive prompts beat short ones for consistency

The ComfyUI route

For a visual workflow, the community wrapper keeps LongCat nodes on its main branch:

cd ComfyUI/custom_nodes
git clone https://github.com/kijai/ComfyUI-WanVideoWrapper.git
cd ComfyUI-WanVideoWrapper
pip install -r requirements.txt
git rev-parse HEAD

Record the commit printed by that last command with every saved workflow, then start from the repository's LongCatAvatar_audio_image_to_video_example_01.json example instead of an untraceable JSON from a video description. The wrapper is a personal, perpetually work-in-progress sandbox — update it in a separate copy, run one known input, and keep the last working commit so a node rename cannot break all jobs at once. There is no official Meituan ComfyUI node: the meituan-longcat organisation publishes the model, not a ComfyUI extension.

Inputs that prevent wasted runs

Bad inputs cause more avatar failures than weak hardware. Before you generate anything, satisfy this checklist:

  1. Use a sharp portrait with the full head visible and no object covering the face
  2. Start with one speaker and a short, clean WAV file before attempting multi-person audio
  3. Keep the audio sample rate and channel layout consistent across every test
  4. Write a prompt that describes identity, framing, clothing, background, and restrained motion
  5. Record the model filename, wrapper commit, workflow JSON, seed, dimensions, duration, and audio filename with every saved result
  6. Confirm the audio has no loud background music or overlapping voices on the first pass
  7. Avoid extreme close-ups that crop the jaw or forehead, which the lip-sync motion relies on
  8. Reuse the same portrait across comparisons so you can isolate audio and prompt changes

VRAM and duration: measure, do not guess

The official Avatar 1.5 pages do not publish a universal "works on 8GB / 12GB" minimum. Community FP8, GGUF, CPU offload, block-swap and INT8 (the --use_int8 flag above) workflows can reduce peak VRAM, but the real number depends on checkpoint format, resolution, frame count, attention backend, system RAM, and wrapper version. Use a bounded test ladder:

  1. Run the repository's known example at its documented settings first
  2. Run 3-5 seconds with your own portrait and audio
  3. Record peak VRAM, system RAM, wall time, and output dimensions
  4. Change only one variable at a time between runs
  5. Increase duration only after lip sync and identity remain stable

"Supports long video" does not mean an infinite clip has zero drift. Continuation is a repeated generation operation — inspect every join for face changes, color shifts, hand artifacts, background jumps, and audio offset.

Failure triage

SymptomLikely boundaryFirst action
Nodes are missingWrapper install or stale node definitionsRestart ComfyUI and verify the pinned wrapper commit
Checkpoint will not loadOriginal Avatar and Avatar 1.5 files were mixedVerify the exact model filename and upstream source
CUDA out of memoryResolution, frames, model format, or insufficient offloadReduce one dimension, shorten the clip, then measure again
Lips lag behind audioAudio preprocessing, frame timing, or wrong encoder pathTest clean single-speaker audio on the official v1.5 example
Identity changes at joinsContinuation overlap or difficult source framingShorten the continuation and use a clearer reference image
First run works, update breaksMoving community dependenciesReturn to the recorded commit and upgrade in a separate copy

Production checklist before you publish

  • Watch the complete result with sound and verify lip timing, identity, hands, teeth, and eye motion
  • Check scene continuity at every continuation join
  • Confirm you have the rights to the portrait and the audio you used
  • Review the model license separately from "open source" — the weights are MIT licensed, but your own inputs have their own rights
  • Apply any disclosure or consent requirements your platform imposes on synthetic media
  • Keep the wrapper commit and model filename beside the final file for future reproducibility

What you can and cannot do on this site

The hosted generator on longcat-video.org is an image-to-video tool: a still image plus a motion prompt, priced at 150-300 credits per run depending on model and resolution, with the exact cost quoted before submission and purchased credits required from the first hosted run. It has no audio input, so it cannot produce a talking avatar.

  • No audio, no lip sync — the hosted workflow cannot do it at any price tier; it is not a feature you unlock later
  • Motion from a still image — use the hosted image-to-video workflow for silent clips
  • Speech-driven video — run Avatar 1.5 locally using the steps above, or follow the ComfyUI avatar tutorial for the wrapper-based route
  • Pricing for the hosted runs — every credit pack is listed on /pricing

Frequently Asked Questions

What is a LongCat video avatar?

It is an audio-driven talking head. You supply a still portrait and a voice clip, and the LongCat-Video-Avatar-1.5 model generates a video of that face speaking the audio with matching lip movement.

Can the hosted LongCat Video tool make a talking avatar?

No. The generator on this site takes a still image and a motion prompt; it has no audio input and no lip-sync path. Audio-driven avatars need the local Avatar 1.5 setup described on this page.

Which checkpoint do I need for avatar generation?

LongCat-Video-Avatar-1.5. It uses a Whisper-Large-v3 audio encoder instead of the wav2vec2 encoder in the original Avatar model, and it requires distillation sampling: pass --use_distill --model_type avatar-v1.5, or the run fails instead of falling back.

What inputs produce the most reliable result?

A sharp portrait with the full head visible, one speaker, and a short clean WAV file with consistent sample rate and channel layout. Start single-speaker before attempting multi-person audio, and keep the same portrait when you compare settings.

How much VRAM does LongCat Video Avatar need?

There is no published universal minimum. FP8, GGUF, CPU offload, block-swap, and INT8 (--use_int8) reduce peak usage, but the real requirement depends on resolution, frames, checkpoint format, and the attention backend. Measure with a 3-5 second test instead of assuming a figure.

Can a LongCat avatar run indefinitely without drift?

No. Continuation is a repeated generation operation, so inspect every join for face changes, color shifts, and audio offset. Increase duration only after lip sync and identity stay stable on shorter clips.

Choose the right workflow for your portrait

Use a local Avatar 1.5 environment for speech-driven lip sync. The hosted image-to-video tool animates a still image without audio input.