prevent app from crashing #410
Description
hi, im having trouble where the api would randomly crash. and i cant pinpoint why. at one case it crashed while loading model. some other crashed while saving. i noticed that sometimes its still keeping the model inside vram, and possibly ran out of memory and crashed.
is there a way i could get more verbose information on why it crashed, as well as trying to prevent it from crashing. since it takes me 5 atleast 5 minutes to stop the instance and turn it back on.
im using AWS G5, with 24gb vram and 16gb ram.