Request: BLIP2 memory optimizations?

[jim-22]

This issue on the LAVIS repository salesforce/LAVIS#118 shows someone who managed to fit BLIP2 onto his 24 GB VRAM card. Would it be possible to apply that to this repo?

[theovercomer8]

You can try out the 8bit branch. It has the 8bit stuff integrated. I think there were a lot of problems though when I had some friends testing it.