AMD Support

[Rob-P-Smith]

Just though I'd add here, it would be great to have AMD GPU support when you get around to it.

Would love to test it out to finally get vLLM to place nicely with 6.4.2 on RDNA 4.

PS: Open to being a test-mule if you need one for AMD.

[Chen-zexi]

Hi, I do not have any AMD GPU and thats why this task was pending. I do very much want to bring this to AMD users!

I will remove any hard limit for Nvidia from the code and reach out to you once I have a pre-release ready. Also feel free to make a PR for it if you want!

Thanks!