Skip to content

README.md

Latest commit

 

History

History
79 lines (62 loc) · 2.2 KB

README.md

File metadata and controls

79 lines (62 loc) · 2.2 KB

Full Test Set

Here, we provide the full test set to reproduce our results or evaluate other methods on the dataset.

  • Single Reference Pictures: ./stylepic_single_ref/
  • Multiple Reference Pictures: ./stylepic_multi_ref/
  • Prompts for Image Generation: ./prompts/content_prompt_img.txt
  • Prompts for Video Generation: ./prompts/content_prompt_vid.txt
  • Json File for Single Reference Image Generation: ./eval_image_gen_single_ref_full.json
  • Json File for Multiple Reference Image Generation: ./eval_image_gen_multi_ref_full.json
  • Json File for Single Reference Video Generation: ./eval_video_gen_single_ref_full.json
  • Json File for Multiple Reference Video Generation: ./eval_video_gen_multi_ref_full.json

Instructions for Inference Your Own Data

Follow these steps to perform inference on your own data:

1. Step1: Prepare Your JSON file

We support inference on your own data by simply modifying the JSON file. Both single-reference and multiple-reference styles are supported.

For a single-reference style, use the following JSON format:

[
    {
        "prompt": "Your prompt1",
        "style_path": "data/style_1.png"
    },
    {
        ...
    }
]

For a multiple-reference style, use the following JSON format:

[
    {
        "prompt": "Your prompt1",
        "style_path": [
            "data/style_1.png",
            "data/style_2.png",
            "data/style_3.png"
        ]
    },
    {
        ...
    }
]

Note that the style path should be a relative path. We recommend organizing your test data according to the following structure:

.
├── your_eval_data
│   ├── data
│   │   ├── style_1.png
│   │   ├── style_2.png
│   │   └── style_3.png
│   └── eval_data.json
├── ...

2. Step2: modify the eval script

Update the prompt_dir and filename in the scripts/run_infer_video.sh script to point to your own test data. For example:

...
prompt_dir="/path/to/your_eval_data"
filename="eval_data.json"
...

After completing these steps, you can run the modified evaluation script to perform inference on your own data using the specified styles.