Skip to content

About video memory optimization[Quantitative model] #38

@klossm

Description

@klossm

DiffRhythm 1.2 seems to have increased video memory requirements. I used gemini to modify infer_utils.py and added quantization. The video memory barely maintained at 5.9G, The video memory will increase slightly in the later stages.My graphics card is 1070TI 8GB.I'm not a professional,I hope this helps people whose hardware doesn't meet the requirements.

You need to install dependencies,
pip install optimum or pip install optimum[quanto]
If torchao is not automatically installed, try:
pip install torchao packaging

Modify the suffix of the attachment to py

infer_utils.txt

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions