Pretraining Data

[vishalned]

Hey,

Any chance we could get the pretraining data ?

[Tarekbouamer]

Hi @gabrieltseng , great work on Galileo!

Are you planning to release the training dataset used in the paper? Thanks!

[gabrieltseng]

Hi @Tarekbouamer and @vishalned -

Thanks for your interest, and sorry for the slow reply. Finding somewhere to host the dataset has proved a bit challenging.

I am currently uploading it to https://huggingface.co/datasets/nasaharvest/galileo-pretrain/tree/main, but running into size issues. I've contacted the huggingface datasets team to try and resolve this, but in the meantime a (very small) subset of the dataset is available at the link.

I'll keep running the upload script, so there should be a drip of additional h5 files, and I'll let you know if I hear back from huggingface.

[vishalned]

Thanks for the update. We were hoping to use it for our FDL project, so will still be useful later on.