How much memory required for a 512-frame video generation?

Thanks for sharing this great work. From the code, I saw that the network input is the whole noise of a long video, and I wonder doesn't it lead to a very large memory cost? 