gender preprocessing

[daeyun]

Hi,

Thanks for this amazing work! This is great.

I see that there's a new script for preprocessing AMASS:

https://gist.github.com/brentyi/a52bfaee37734d30d60e3ab1a092e645

Is this necessary to reproduce the motion prior training?

And I'm wondering where the gender_conversion/{gender}_to_neutral.npz file and hydra config files ("amass_cfg"?) can be found.

Or is it enough to just run process_amass_data.py and cleanup_amass_data.py (from HuMoR) followed by 0_preprocess_training_data.py?

Thank you for your time!

[brentyi]

Hi @daeyun, thanks for the issue! Unfortunately the modified preprocessing is necessary, mostly for gender neutral body shapes.

I overlooked some things when uploading that gist. I just updated it and uploaded the gender conversion npz files here, sorry for the trouble!

This diff from the gist might also be useful, it shows the differences that matter when compared to the original HuMoR script: https://gist.github.com/brentyi/a52bfaee37734d30d60e3ab1a092e645/revisions#diff-80e4a9e46cf80e8550448a87d7209a7f00633a3025dfe24f0596778e589b5192

[daeyun]

Thank you so much! 🙆‍♂

[brentyi]

Hi @daeyun! FYI I just merged #15 which has some updates to the preprocessing instructions. 🙂

[daeyun]

Thanks @brentyi ! 👏

If I understand correctly, 0a_preprocess_training_data is the same as the gist, and 0b_preprocess_training_data is the old 0_preprocess_training_data. So if I already used those two scripts, there's no need to re-generate the data, right?

Also I see that guidance_optimizer_jax.py changed (due to the jaxls API update?) Is it mostly a name change, or do you recommend updating to the latest version? Thanks always for your time.

[brentyi]

Preprocessing: there are unfortunately some differences that will impact results, for example the gist version is missing the reflected versions of sequences. I don't think this will make or break things, but the new 0a_preprocessing_training_data.py script should be matched to the EgoAllo paper results.

Guidance optimizer: this is primarily naming, updating isn't necessary.