Skip to content

feat: add CUDA GPU acceleration for Windows x64#1

Open
egsok wants to merge 2 commits intomainfrom
feat/cuda-support
Open

feat: add CUDA GPU acceleration for Windows x64#1
egsok wants to merge 2 commits intomainfrom
feat/cuda-support

Conversation

@egsok
Copy link
Owner

@egsok egsok commented Mar 6, 2026

Summary

  • Add optional cuda Cargo feature enabling whisper-rs CUDA backend via feature unification with transcribe-rs
  • Add CUDA Toolkit auto-detection in build.rs and scripts/build-cuda.sh helper
  • Add CI: CUDA Toolkit install, DLL bundling (cublas, cublasLt, cudart), release matrix with handy-cuda asset prefix

Test plan

  • CI build passes for default (Vulkan-only) Windows x64
  • CI build passes for CUDA Windows x64 variant
  • On NVIDIA GPU machine: verify whisper.cpp logs show CUDA backend active

🤖 Generated with Claude Code

egsok and others added 2 commits March 6, 2026 21:51
Add optional CUDA backend alongside existing Vulkan for significantly
faster transcription on NVIDIA GPUs.

- Add `cuda` Cargo feature that enables whisper-rs/cuda via feature unification
- Add CUDA Toolkit auto-detection in build.rs (checks CUDA_PATH env var)
- Add CI steps: CUDA Toolkit install, DLL bundling (cublas, cublasLt, cudart)
- Add CUDA variant to release matrix (asset prefix: handy-cuda)
- Add build-cuda.sh helper script for local builds with auto-detection

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant