SadTalker

SadTalker

一图片与音频文件合成人物说话动画

Develop

git clone https://github.com/OpenTalker/SadTalker.git

cd SadTalker 

conda create -n sadtalker python=3.8

conda activate sadtalker

pip install torch==1.12.1+cu113 torchvision==0.13.1+cu113 torchaudio==0.12.1 --extra-index-url https://download.pytorch.org/whl/cu113

conda install ffmpeg

pip install -r requirements.txt

# 下载权重
bash scripts/download_models.sh
# https://github.com/OpenTalker/SadTalker/releases

# 推理，指定语音，图片
python inference.py --driven_audio <audio.wav> \
                    --source_image <video.mp4 or picture.png> \
                    --result_dir <a file to store results> \
                    --still \
                    --preprocess full \
                    --enhancer gfpgan

https://colab.research.google.com/github/Winfredy/SadTalker/blob/main/quick_demo.ipynb

https://huggingface.co/spaces/vinthony/SadTalker 这种排队要很久

人脸工具：https: //github.com/xinntao/facexlib

人脸增强：https://github.com/TencentARC/GFPGAN

图像/视频增强：https://github.com/xinntao/Real-ESRGAN