DeepSpeed wheel for windows and pytorch 2.7.1 cuda 12.8, note that you need nvidia cuda toolkit installed otherwise you will get an error when activating DeepSpeed and use it.
https://developer.nvidia.com/cuda-12-8-1-download-archive?target_os=Windows&target_arch=x86_64.