GPU Simulator

[eteral00]

Hello

From the introduction in the readme, it implies that a GPU simulator, such as GPGPU-Sim, can be plugged into SimAI to simulate the computation kernels.
I would like to ask if anyone has actually tried to plug GPGPU-Sim (or better yet, Accel-Sim) into SimAI?
And how should it be done? -- i.e. does SimAI already include some input/output interface to plug GPGPU-Sim in, or do we need to create a new interface for that?

Thank you.

[tianhao909]

Hello,

You can replace the kernel profiling interface in aiob/aicb with a compute simulator such as GPGPU-Sim. In this setup, the execution time of compute kernels would be provided by your simulator (e.g., GPGPU-Sim or, even better, Accel-Sim).

For implementation guidance, you can refer to the approach used in this commit that adapted DeepSeek: it replaced the original nn.Module compute kernels with DeepGEMM kernels and profiled their execution time on Hopper GPUs. A similar strategy should work when integrating your compute simulator （such as GPGPU-Sim or better yet, Accel-Sim）.

Relevant links:
https://github.com/aliyun/aicb/commits/master/
aliyun/aicb#41

Hope this helps!