Hi, thanks for sharing the code of your interesting work.
I saw run_pretrain.py in your repo; however, there is a missing config file ./configs/Pretrain.yaml' and script for running the pretraining.
Since the pretraining strategy is one of your novel contributions, would you have planned to release the complete code for reproducing the pretraining?