[Feature Request]: Webui implementation?

[Maki9009]

pls

[neggles]

Unfortunately the automatic1111 webui is a nightmare to integrate with; between modifications that have to be made to the model, sampling process, and attention implementation, I suspect I'd end up wanting to claw my eyes out even more than I usually do when working with that codebase.

PRs are welcome (if they have decent code quality or people don't mind me rewriting half of it before merging) but I am absolutely not going to integrate with auto1111 myself.

That said, I am going to add a little webui to this, and I have someone lined up to make a colab notebook for it once that's done 😄

[Maki9009]

well not using Automatics webui... but use the webui from the same original repo

[neggles]

The original repo has a webui? That's news to me...

[neggles]

Oh hey, so it does! Neat. well, that was already on my list of things to do, so I'll try to get to that in the next day or two depending on how busy I am 😄

[Maki9009]

Thank you :), because not gonna lie i reached the final part of the installation and generating... and i didn't know how to do that i kept pointing to the yaml file and nothing was happening... I'm pretty sure i was doing something wrong, but a webUI would be dope

[neggles]

Ah, yeah, this CLI takes .json files rather than .yamls (im not a huge fan of yaml for this stuff); there's some examples in config/prompts, they're pretty close to the original yaml format but not exactly the same.

I'll probably be able to throw something together in Gradio tomorrow (i'm in Australia so it's pretty late here 😉) but no promises!

[Maki9009]

i mean .json file yeah, i got to this point in the installation process, animatediff --help.. tried to point to my json file... couldn't figure it out

[neggles]

animatediff generate -c 'config/prompts/json-name.json' -W 576 -H 576 -L 16 should work - oh, one thing i should mention is that the path to the checkpoint in the JSON is relative to the data/ directory, so if your checkpoint is in (say) data/models/sd/SomethingV2_2.safetensors then you'd put something like this:

{
  "name": "miku",
  "base": "",
  "path": "models/sd/SomethingV2_2.safetensors",
  "motion_module": "models/motion-module/mm_sd_v14.ckpt",
  "seed": [-1, -1],
  "scheduler": "ddim",
  "steps": 20,
  "guidance_scale": 8.25,
  "prompt": [
        "hatsune miku, 1girl, upper body, clouds, twintails, happy, smile, hand on own cheek, :d, looking at viewer, from side, best quality",
        "hatsune miku, 1girl, full body, blue hair, twintails, happy, smile, looking at viewer, dramatic, masterpiece, best quality",
  ],
  "n_prompt": [
    "simple colors, simple background, low quality, worst quality, bad quality"
  ]
}

If you save that as config/prompts/something.json, then you'd run:

animatediff generate -c 'config/prompts/something.json' -W 576 -H 576 -L 16

and that should Just Work™ (you'll also need to have downloaded the motion module from the original repo's gdrive links and put them in data/models/motion-module/)

[edit]: Side note: Use PowerShell, not cmd.exe :)

[Maki9009]

alright well idk whats wrong atm... but the first time the installation process worked, now
python3.10 -m venv .venv
source .venv/bin/activate

arent working, py -m venv .venv i think that does the job because it doesn't bring a error that python isn't recognized
but
source doesn't work it doesn't recognize it....
not sure what went wrong cuz it worked the last time i tired to install it

i tired both Powershell and cmd

[Skquark]

I've been working on integrating it into my GUI for Stable Diffusion Deluxe and almost got it all working. Started with the originals AnimateDiff, but quickly realized that all the dependencies are "ancient" and just wouldn't work with the rest of my project that requires latest Diffusers and Torch.. So I appreciate you refactoring things. Here's what it looks like so far....

Almost works now, but still hitting an error:

╭───────────────────── Traceback (most recent call last) ──────────────────────╮
│ /content/animatediff-cli/src/animatediff/cli.py:294 in generate              │
│                                                                              │
│   291 │   model_name_or_path = get_base_model(model_name_or_path, local_dir= │
│   292 │                                                                      │
│   293 │   # Ensure we have the motion modules                                │
│ ❱ 294 │   get_motion_modules()                                               │
│   295 │                                                                      │
│   296 │   # get a timestamp for the output directory                         │
│   297 │   time_str = datetime.now().strftime("%Y-%m-%dT%H-%M-%S")            │
│                                                                              │
│ /content/animatediff-cli/src/animatediff/utils/model.py:185 in               │
│ get_motion_modules                                                           │
│                                                                              │
│   182 │   │   │   │   local_dir_use_symlinks=False,                          │
│   183 │   │   │   │   resume_download=True,                                  │
│   184 │   │   │   )                                                          │
│ ❱ 185 │   │   │   logger.debug(f"Downloaded {path_from_cwd(result)}")        │
│   186                                                                        │
│   187                                                                        │
│   188 def get_base_model(model_name_or_path: str, local_dir: Path, force: bo │
│                                                                              │
│ /content/animatediff-cli/src/animatediff/utils/util.py:43 in path_from_cwd   │
│                                                                              │
│   40                                                                         │
│   41                                                                         │
│   42 def path_from_cwd(path: Path) -> str:                                   │
│ ❱ 43 │   return str(path.absolute().relative_to(Path.cwd()))                 │
│   44                                                                         │
╰──────────────────────────────────────────────────────────────────────────────╯
AttributeError: 'str' object has no attribute 'absolute'

I was originally using absolute path to point to the motion_module and lora because wanted it working with Windows paths too, but I modified it to relative path like the example, but still gives that error. So close, any suggestions? Thanks.