Enquiry on the Patchification

[steveveve123]

Thanks for your great work!

I have a question about the patchification of MAR. What is the intuition behind designing MAR to patchify the extracted feature instead of directly patchifying the image like MAR or DINO?

[LTH14]

In diffusion models, operating on the latent space typically gives better performance than pixel space, so our major experiments also follow this. In the appendix, we also include results on ImageNet 64, where we directly patchify the image.