should varaible "rotmat_recon" in decode function match to 'global_xform' ?

[ChangjianLi]

hi, I have a little question about the generative model. I looked throught the code, in decode function, the varaible "rotmat_recon" is transformed from "local_motion". And it is transformed into varaible "local_rotmat" using function self.fk.global_to_local() for calculating "pos_recon"

so can it be regarded as the reconstructed "global_xform"? The "rotmat_recon" is further assigned as output['rotmat']. In backward() function , it is used to calculate the rotmat_recon_loss by comparing with self.input_data['rotmat']. But does the gt varaible self.input_data['rotmat'] should be gt "local_rotmat" instead of gt "global_xform"? Because in data processing the varaible "rotmat" is calculated straight from smpl data

[c-he]

Hi Changjian, sorry for the confusion caused by my bad coding style. rotmat in data processing are local rotation matrices, but they are actually not used in the training code. In generative.py, rotmat are actually rotation matrices converted from global transformation, as shown in:

NeMF/src/nemf/generative.py

Line 102 in 7991843

self.input_data['rotmat'] = rotation_6d_to_matrix(self.input_data['global_xform'])

[ChangjianLi]

Haha ok thx, that makes it clear to me, thank you for the reply >_<