Low Image Download Success Rate (~50-60%) for GRIT Dataset Using img2dataset

[Vicky0812]

Hello, thank you very much for your excellent work!

While reproducing your work, I encountered the following issue:

I wanted to download the GRIT dataset to train the model. I downloaded the metadata from Hugging Face and followed their instructions to download the images using img2dataset. However, the success rate of the downloaded images is only around 50%-60%. I also tried different DNS resolvers (including knot-resolver and bind9), but the results were similar.

Is this normal? If not, how can I resolve this problem?

[dyoshyy]

Same problem.
It's worse in my case (under 10%).

[laiyingxin2]

Same problem~