Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ This is the official implementation of GeneFace++ [Paper](https://arxiv.org/abs/
## Quick Start!
We provide a guide for a quick start in GeneFace++.

- Step 1: Follow the steps in `docs/prepare_env/install_guide.md`, create a new python environment named `geneface`, and download 3DMM files into `deep_3drecib/BFM`.
- Step 1: Follow the steps in [docs/prepare_env/install_guide.md](./docs/prepare_env/install_guide.md), create a new python environment named `geneface`, and download 3DMM files into `deep_3drecib/BFM`.

- Step 2: Download pre-processed dataset of May([Google Drive](https://drive.google.com/drive/folders/1SwZ7uRa5ESzzq_Cd21-Lk5heAZxa9oZO?usp=sharing) or [BaiduYun Disk](https://pan.baidu.com/s/1U_FalVoxgb9sAb9FD1cZEw?pwd=98n4) with password 98n4), and place it here `data/binary/videos/May/trainval_dataset.npy`

Expand All @@ -40,7 +40,7 @@ After these steps,your directories `checkpoints` and `data` should be like thi
trainval_dataset.npy
```

- Step 4: activate `geneface` Python environment, and execute:
- Step 4: activateeneface` Python environment, and execute:
```bash
export PYTHONPATH=./
python inference/genefacepp_infer.py --a2m_ckpt=checkpoints/audio2motion_vae --head_ckpt= --torso_ckpt=checkpoints/motion2video_nerf/may_torso --drv_aud=data/raw/val_wavs/MacronSpeech.wav --out_name=may_demo.mp4
Expand All @@ -53,7 +53,7 @@ python inference/app_genefacepp.py --a2m_ckpt=checkpoints/audio2motion_vae --hea
Or use our provided [Google Colab](https://colab.research.google.com/github/yerfor/GeneFacePlusPlus/blob/main/inference/genefacepp_demo.ipynb) and run all cells in it.

## Train GeneFace++ with your own videos
Please refer to details in `docs/process_data` and `docs/train_and_infer`.
Please refer to details in [docs/process_data](./docs/process_data) and [docs/train_and_infer](./docs/train_and_infer).

Below are answers to frequently asked questions when training GeneFace++ on custom videos:
- Please make sure that the head segment occupies a relatively large region in the video (e.g., similar to the provided `May.mp4`). Or you need to hand-crop your training video. [issue](https://github.com/yerfor/GeneFacePlusPlus/issues/30)
Expand Down