OnDevice

OnCPU/OnCUDA (OnDevice) specification

Data flow: Upstream → Upstream cache → Thread → Transfer → Downstream cache → Downstream

Prefetch:

• 0: No cache, sync
• 1: Sync, async transfer, downstream cache
• 2: Threaded upstream prefetch, both caches enabled