[Question] Relative contribution of pipeline and data parallel communication?

[lk-wq]

Hi, I really enjoyed your paper!

I was hoping you could provide some insight into how much pipeline communication and data parallel communication separately contributed to the communication costs. For example, as a percentage how much data transmission was needed for pipeline communication vs how much was needed for data parallel communication for a given device?