Model on single GPU ?

[PiPyL]

hello,

Is there a way to load and serve multiple models on a single GPU
my computer:
gpu: RTX 3060
cpu: i7-12700
ram: 16gb

[phucbienvan]

+1

[dhs1314]

+1