Error compiling locally on CUDA (with fix)

[iamlemec]

Compiling locally with CUDA, running the command from the README:

cargo install --path router -F candle-cuda -F http --no-default-features

I'm getting an error in cudarc:

None between `dynamic-loading`, `dynamic-linking` and `static-linking` features are active

It works fine if I run this:

cargo install --path router -F candle-cuda -F http -F dynamic-linking --no-default-features

Versions: cargo 1.89.0 (c24e10642 2025-06-23) (Arch Linux rust 1:1.89.0-1)

[alvarobartt]

Hey @iamlemec, thanks for flagging! Indeed at most one of dynamic-loading, dynamic-linking or static-linking is required to link CUDA to cudarc, and dynamic-linking comes as default, but given the command above shows --no-default-features that means that any linking is missing, so nice catch, I'll make sure to update the commands! 🤗

i.e., it should also work if you simply remove the --no-default-features flag, as the default features are candle, http and dynamic-linking meaning that:

cargo install --path router -F candle-cuda -F http -F dynamic-linking --no-default-features

is the same as:

cargo install --path router -F candle-cuda

[iamlemec]

Awesome, thanks @alvarobartt!