Unstable GAN in pytorch implementation

[jayantb1019]

I haven't been able to stabilise the GAN using the existing hyper parameters and any tweaks in the same.
Denoiser and discriminator train to a loss of ~0.05 during their respective warm ups. However, GAN training takes the discriminator loss on fake samples to ~1e-7 and then the denoiser stops training altogether.

Could someone share any insights on stabilising the GAN ?
Here's my implementation. https://github.com/jayantb1019/adl_seismic