Skip to content

Incompatible with CUDA 12.9 #85

@mcelrath

Description

@mcelrath

The pinned dependency cudarc = "0.13.9" in this repo breaks compatibility with CUDA 12.9.

How come mistral.rs is not using the upstream huggingface repo? This one is falling out of date...

While compiling mistral.rs:

   Compiling candle-kernels v0.8.0 (https://github.com/EricLBuehler/candle.git?rev=e8209f3#e8209f39)
error: failed to run custom build command for `cudarc v0.13.9`

Caused by:
  process didn't exit successfully: `/home/mcelrath/Projects/ai/mistral.rs/target/release/build/cudarc-8ca714ecfa71d072/build-script-build` (exit status: 101)
  --- stdout
  cargo:rerun-if-changed=build.rs
  cargo:rerun-if-env-changed=CUDA_ROOT
  cargo:rerun-if-env-changed=CUDA_PATH
  cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR

  --- stderr

  thread 'main' panicked at /home/mcelrath/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.13.9/build.rs:92:14:
  Unsupported cuda toolkit version: `12.9`. Please raise a github issue.
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions