GPU内存不足，可否改为8位

[jia95812]

报错torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 512.00 MiB. GPU
可否改为8bit，如何修改？
或者是否有其它方法？

[FreeStyleFreeLunch]

You can adjust the batch size smaller. We have not tried setting it to 8bit, you can try it to see if it works.