Model loss becomes nan

[khoda81]

Actor and critic loss are very high and become nan after a few training steps.
@martiny76

[khoda81]

This seems to be caused by critic_head not being initialized properly which is fixed in f78ecc5. But the original issue is not clear.