QUESTION: how to add a new type of gpu for roller?

[cavalry-yu]

Hi!
I've seen that there are some config files in nnfusion/artifacs/roller/arch/ like V100, K80 and IPU. If I want to add a new GPU like 3090, how to set the config file? Which parameters are necessary？

[xysmlx]

Hi, sorry for late reply.

You can try this experimental RTX3090 config file. Roller requires the information (e.g., bandwidth, transaction size, etc) of each layer in the hardware to calculate proper tile configs for each layer. One of our on-going works is providing a set of micro-benchmarks to automatically provide such information.