Is it possible for inference with RTX4090 24GB? #37
Description
I wonder what should I do to inference with RTX4090 24GB? After create the environment,I find the 24GB memory is not enough and meet the error of OOM. I'd appreciate it for any kindest advice!