fal-lip-sync

Create talking head videos, lip sync audio to video, and animate portraits with expressions. Use when the user requests "Talking head", "Lip sync", "Make this person talk", "Animate portrait", "Live p

SKILL.md

GitHub

fal-lip-sync

Create talking head videos, sync lips to audio, and animate portraits using fal.ai models.

Scripts

Script Purpose
talking-head.sh Generate a talking head video from an image + audio/text
lip-sync.sh Sync lips in an existing video to new audio

Usage

Talking Head (Image + Audio → Video)

./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --audio-url "https://example.com/speech.mp3" --model veed/fabric-1.0

Talking Head (Image + Text → Video with auto TTS)

./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --text "Hello, welcome to our presentation" --model fal-ai/creatify/aurora

Lip Sync (Video + Audio → Synced Video)

./scripts/lip-sync.sh --video-url "https://example.com/video.mp4" --audio-url "https://example.com/new-speech.mp3"

Arguments

talking-head.sh

Argument Description Required
--image-url URL of portrait/face image Yes
--audio-url URL of audio to sync Yes (or --text)
--text Text to speak (auto TTS) Yes (or --audio-url)
--model / -m Model endpoint No (default: veed/fabric-1.0)
--tts-model TTS model for --text mode No (default: fal-ai/minimax/speech-2.6-turbo)
--wait / -w Wait for completion No (default: true)
--async / -a Return request ID immediately No

lip-sync.sh

Argument Description Required
--video-url URL of video to lip sync Yes
--audio-url URL of audio to sync to Yes
--model / -m Model endpoint No (default: fal-ai/sync-lipsync/v2)

Finding Models

To discover the best and latest lip sync and talking head models, use the search API:

# Search for talking head models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "talking head"

# Search for lip sync models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "lip sync"

# Search for live portrait / expression transfer
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "live portrait"

Or use the search_models MCP tool with relevant keywords like "lip sync", "talking head", "avatar".

Output Format

{
  "video": {
    "url": "https://fal.media/files/...",
    "content_type": "video/mp4"
  }
}

Present the video URL directly to the user.