About problems in the training process

[18222why]

Dear professor, I now have a very strange problem. When I was running the fine-tuning, an unexpected problem occurred. The accuracy rate remained at 78.6 and would not be changed until 100epoch.But it has never happened before, and it will train 10 epochs before it will reach 78.6. Is my model overfitting.

[LTH14]

It seems your training loss has not decreased. Maybe it is because the VQ tokenization step loses too much information about the image. For a destructive check, you can try to use a very large learning rate (or a very small one) to see whether the accuracy still remains constant. You can also try to evaluate the accuracy before any training.