Loading Saved Checkpoint After Finetuning #148
Description
Hi,
After finetuning one of your pre-trained models (vmoe_b16_imagenet21k_randaug_strong) using the provided config file, it saves checkpoint in a folder named "1000" within which I have two subfolders named "dataset_iterator" and "state". Within the "state" directory there are files with names "checkpoint", "manifest.ocdbt", "_sharding" and a folder named "d". Within the "d" directory there are many randomly named files. How can I convert this checkpoint to generate the ".data-00000-of-00001" and the ".index" file in this scenario? Can you please give me some directions on that?
Many thanks.