GPU memory cost too much

[panxkun]

Hi, recently I study the code of DPSNet and yours DeepSFM, and I found when running the training code, it will cost the GPU memory too much. For example, it will cost 20+G on V100 with batch size= 1 with only the PSNet , which is so weird. I think this maybe concerned with the version of pytorch, because DPSNet and DeepSFM all required pytorch 0.4.0 but I use the pytorch 1.6.0, So I want to confirm that the exactly version of pytorch is important to reporduce the expriment.