Skip to content

Conversation

@shermansiu
Copy link
Contributor

Checklist

  • Used a personal fork of the feedstock to propose changes
  • Bumped the build number (if the version is unchanged)
  • Reset the build number to 0 (if the version changed)
  • Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
  • Ensured the license file is being packaged.

@shermansiu shermansiu requested a review from maresb as a code owner September 1, 2025 09:34
@shermansiu shermansiu changed the title [ci skip] Attempt to add CUDA build for AArch64 Attempt to add CUDA build for AArch64 Sep 1, 2025
@shermansiu
Copy link
Contributor Author

@conda-forge-admin, please rerender

@conda-forge-admin
Copy link
Contributor

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/recipe.yaml) and found it was in an excellent condition.

@shermansiu
Copy link
Contributor Author

shermansiu commented Sep 1, 2025

Here are some errors from when I've tried to build this:

  running build_ext
  nvcc warning : incompatible redefinition for option 'compiler-bindir', the last value of this option was used
  Re-run cmake no build system arguments
  -- Build type: Release
  -- Target device: cuda
  -- Found python matching: /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/bin/python.
  CMake Warning (dev) at CMakeLists.txt:70 (find_package):
    Policy CMP0146 is not set: The FindCUDA module is removed.  Run "cmake
    --help-policy CMP0146" for policy details.  Use the cmake_policy command to
    set the policy and suppress this warning.

  This warning is for project developers.  Use -Wno-dev to suppress it.
  
  -- Could NOT find CUDA (missing: CUDA_TOOLKIT_ROOT_DIR) (found version "12.6")
  -- Could NOT find ZLIB (missing: ZLIB_LIBRARY ZLIB_INCLUDE_DIR)
  -- Caffe2: Found protobuf with new-style protobuf targets.
  -- Caffe2: Protobuf version 29.3.0
  nvcc warning : incompatible redefinition for option 'compiler-bindir', the last value of this option was used
  CMake Error at /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/share/cmake-4.1/Modules/CMakeDetermineCompilerId.cmake:928 (message):
    Compiling the CUDA compiler identification source file
    "CMakeCUDACompilerId.cu" failed.

    Compiler:
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin/nvcc

    Build flags:

    Id flags: --keep;--keep-dir;tmp -v



    The output was:

    1

    nvcc warning : incompatible redefinition for option 'compiler-bindir', the
    last value of this option was used

    #$ NVCC_PREPEND_FLAGS="
    -ccbin=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/bin/aarch64-conda-linux-gnu-c++
    -ccbin=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-c++"

    #$ NVCC_APPEND_FLAGS="
    -I/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include
    -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib
    -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs
    -I/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include
    -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib
    -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs"

    #$ _NVVM_BRANCH_=nvvm

    #$ _SPACE_=

    #$ _CUDART_=cudart

    #$
    _HERE_=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin

    #$
    _THERE_=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin

    #$ _TARGET_SIZE_=

    #$ _TARGET_DIR_=

    #$ _TARGET_SIZE_=64

    #$ rm tmp/a_dlink.reg.c

    #$
    "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++
    -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -E -x c++ -D__CUDACC__
    -D__NVCC__
    -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"
    -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"
    -D__CUDACC_VER_MAJOR__=12 -D__CUDACC_VER_MINOR__=6
    -D__CUDACC_VER_BUILD__=85 -D__CUDA_API_VER_MAJOR__=12
    -D__CUDA_API_VER_MINOR__=6 -D__NVCC_DIAG_PRAGMA_SUPPORT__=1 -include
    "cuda_runtime.h" "CMakeCUDACompilerId.cu" -o
    "tmp/CMakeCUDACompilerId.cpp4.ii"

    #$ cudafe++ --c++17 --gnu_version=130400 --display_error_number
    --orig_src_file_name "CMakeCUDACompilerId.cu" --orig_src_path_name
    "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/work/vllm/build/temp.linux-aarch64-cpython-312/CMakeFiles/4.1.1/CompilerIdCUDA/CMakeCUDACompilerId.cu"
    --allow_managed --unsigned_chars --unsigned_wchar_t --arm_cross_compiler
    --m64 --parse_templates --gen_c_file_name
    "tmp/CMakeCUDACompilerId.cudafe1.cpp" --stub_file_name
    "CMakeCUDACompilerId.cudafe1.stub.c" --gen_module_id_file
    --module_id_file_name "tmp/CMakeCUDACompilerId.module_id"
    "tmp/CMakeCUDACompilerId.cpp4.ii"

    #$
    "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++
    -D__CUDA_ARCH__=520 -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -E -x c++
    -DCUDA_DOUBLE_MATH_FUNCTIONS -D__CUDACC__ -D__NVCC__
    -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"
    -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"
    -D__CUDACC_VER_MAJOR__=12 -D__CUDACC_VER_MINOR__=6
    -D__CUDACC_VER_BUILD__=85 -D__CUDA_API_VER_MAJOR__=12
    -D__CUDA_API_VER_MINOR__=6 -D__NVCC_DIAG_PRAGMA_SUPPORT__=1 -include
    "cuda_runtime.h" "CMakeCUDACompilerId.cu" -o
    "tmp/CMakeCUDACompilerId.cpp1.ii"

    #$ cicc --c++17 --gnu_version=130400 --display_error_number
    --orig_src_file_name "CMakeCUDACompilerId.cu" --orig_src_path_name
    "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/work/vllm/build/temp.linux-aarch64-cpython-312/CMakeFiles/4.1.1/CompilerIdCUDA/CMakeCUDACompilerId.cu"
    --allow_managed --unsigned_chars --unsigned_wchar_t --arm_cross_compiler
    -arch compute_52 -m64 --no-version-ident -ftz=0 -prec_div=1 -prec_sqrt=1
    -fmad=1 --include_file_name "CMakeCUDACompilerId.fatbin.c" -tused
    --module_id_file_name "tmp/CMakeCUDACompilerId.module_id" --gen_c_file_name
    "tmp/CMakeCUDACompilerId.cudafe1.c" --stub_file_name
    "tmp/CMakeCUDACompilerId.cudafe1.stub.c" --gen_device_file_name
    "tmp/CMakeCUDACompilerId.cudafe1.gpu" "tmp/CMakeCUDACompilerId.cpp1.ii" -o
    "tmp/CMakeCUDACompilerId.ptx"

    #$ ptxas -arch=sm_52 -m64 "tmp/CMakeCUDACompilerId.ptx" -o
    "tmp/CMakeCUDACompilerId.sm_52.cubin"

    #$ fatbinary --create="tmp/CMakeCUDACompilerId.fatbin" -64
    --cicc-cmdline="-ftz=0 -prec_div=1 -prec_sqrt=1 -fmad=1 "
    "--image3=kind=elf,sm=52,file=tmp/CMakeCUDACompilerId.sm_52.cubin"
    "--image3=kind=ptx,sm=52,file=tmp/CMakeCUDACompilerId.ptx"
    --embedded-fatbin="tmp/CMakeCUDACompilerId.fatbin.c"

    #$
    "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++
    -D__CUDA_ARCH__=520 -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -c -x c++
    -DCUDA_DOUBLE_MATH_FUNCTIONS -Wno-psabi
    -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"
    -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"
    "tmp/CMakeCUDACompilerId.cudafe1.cpp" -o "tmp/CMakeCUDACompilerId.o"

    #$ nvlink -m64 --arch=sm_52 --register-link-binaries="tmp/a_dlink.reg.c"
    -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib"
    -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs"
    -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib"
    -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs"
    -cpu-arch=AARCH64 "tmp/CMakeCUDACompilerId.o" -lcudadevrt -o
    "tmp/a_dlink.sm_52.cubin" --host-ccbin
    "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-c++"

    #$ fatbinary --create="tmp/a_dlink.fatbin" -64 --cicc-cmdline="-ftz=0
    -prec_div=1 -prec_sqrt=1 -fmad=1 " -link
    "--image3=kind=elf,sm=52,file=tmp/a_dlink.sm_52.cubin"
    --embedded-fatbin="tmp/a_dlink.fatbin.c"

    #$
    "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++
    -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -c -x c++
    -DFATBINFILE="\"tmp/a_dlink.fatbin.c\""
    -DREGISTERLINKBINARYFILE="\"tmp/a_dlink.reg.c\"" -I.
    -D__NV_EXTRA_INITIALIZATION= -D__NV_EXTRA_FINALIZATION=
    -D__CUDA_INCLUDE_COMPILER_INTERNAL_HEADERS__ -Wno-psabi
    -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"
    -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"
    -D__CUDACC_VER_MAJOR__=12 -D__CUDACC_VER_MINOR__=6
    -D__CUDACC_VER_BUILD__=85 -D__CUDA_API_VER_MAJOR__=12
    -D__CUDA_API_VER_MINOR__=6 -D__NVCC_DIAG_PRAGMA_SUPPORT__=1
    "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin/crt/link.stub"
    -o "tmp/a_dlink.o"

    cc1plus: fatal error:
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin/crt/link.stub:
    No such file or directory

    compilation terminated.

    # --error 0x1 --





  Call Stack (most recent call first):
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/share/cmake-4.1/Modules/CMakeDetermineCompilerId.cmake:8 (CMAKE_DETERMINE_COMPILER_ID_BUILD)
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/share/cmake-4.1/Modules/CMakeDetermineCompilerId.cmake:53 (__determine_compiler_id_test)
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/share/cmake-4.1/Modules/CMakeDetermineCUDACompiler.cmake:162 (CMAKE_DETERMINE_COMPILER_ID)
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/share/cmake/Caffe2/public/cuda.cmake:45 (enable_language)
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/share/cmake/Caffe2/Caffe2Config.cmake:86 (include)
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
    CMakeLists.txt:82 (find_package)

  
  -- Configuring incomplete, errors occurred!
  Traceback (most recent call last):
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
      main()
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
      json_out["return_val"] = hook(**hook_input["kwargs"])
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
      return _build_backend().build_wheel(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/build_meta.py", line 438, in build_wheel
      return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/build_meta.py", line 426, in _build
      return self._build_with_temp_dir(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir
      self.run_setup()
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/build_meta.py", line 320, in run_setup
      exec(code, locals())
    File "<string>", line 680, in <module>
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
      dist.run_commands()
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 983, in run_commands
      self.run_command(cmd)
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command
      super().run_command(command)
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
      cmd_obj.run()
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 369, in run
      self.run_command("build")
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command
      self.distribution.run_command(command)
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command
      super().run_command(command)
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
      cmd_obj.run()
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 136, in run
      self.run_command(cmd_name)
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command
      self.distribution.run_command(command)
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command
      super().run_command(command)
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
      cmd_obj.run()
    File "<string>", line 273, in run
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 365, in run
      self.build_extensions()
    File "<string>", line 232, in build_extensions
    File "<string>", line 210, in configure
    File "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/python3.12/subprocess.py", line 413, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/work/vllm', '-G', 'Ninja', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DVLLM_TARGET_DEVICE=cuda', '-DCMAKE_VERBOSE_MAKEFILE=ON', '-DVLLM_PYTHON_EXECUTABLE=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/bin/python', '-DVLLM_PYTHON_PATH=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process:/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/python3.12/lib-dynload:/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages:/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python312.zip:/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.12:/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.12/lib-dynload:/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.12/site-packages:/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/python3.12/site-packages/setuptools/_vendor:/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/venv/lib/exposed.txt', '-DFETCHCONTENT_BASE_DIR=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/work/vllm/.deps', '-DNVCC_THREADS=1', '-DCMAKE_JOB_POOL_COMPILE:STRING=compile', '-DCMAKE_JOB_POOLS:STRING=compile=24', '-DCMAKE_CUDA_COMPILER=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin/nvcc', '-DCMAKE_AR=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-ar', '-DCMAKE_CXX_COMPILER_AR=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-gcc-ar', '-DCMAKE_C_COMPILER_AR=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-gcc-ar', '-DCMAKE_RANLIB=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-ranlib', '-DCMAKE_CXX_COMPILER_RANLIB=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-gcc-ranlib', '-DCMAKE_C_COMPILER_RANLIB=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-gcc-ranlib', '-DCMAKE_LINKER=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-ld', '-DCMAKE_STRIP=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-strip', '-DCMAKE_BUILD_TYPE=Release', '-DCMAKE_FIND_ROOT_PATH_MODE_PROGRAM=NEVER', '-DCMAKE_FIND_ROOT_PATH_MODE_LIBRARY=ONLY', '-DCMAKE_FIND_ROOT_PATH_MODE_INCLUDE=ONLY', '-DCMAKE_FIND_ROOT_PATH=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/aarch64-conda-linux-gnu/sysroot', '-DCMAKE_INSTALL_PREFIX=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold', '-DCMAKE_INSTALL_LIBDIR=lib', '-DCMAKE_PROGRAM_PATH=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/bin', '-DCMAKE_SYSTEM_NAME=Linux', '-DCMAKE_SYSTEM_PROCESSOR=aarch64', '-DCMAKE_FIND_ROOT_PATH=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/aarch64-conda-linux-gnu/sysroot;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux', '-DPython_INCLUDE_DIR=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/include/python3.12', '-DCUDAToolkit_ROOT=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux', '-DCUDA_CUDART_LIBRARY=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/lib/libcudart.so']' returned non-zero exit status 1.
  error: subprocess-exited-with-error

When I try to copy $BUILD_PREFIX/bin/crt to $BUILD_PREFIX/targets/sbsa-linux/bin/

CMake Error at /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/share/cmake-4.1/Modules/Internal/CMakeNVCCParseImplicitInfo.cmake:143 (message):
    Failed to extract nvcc implicit link line.
  Call Stack (most recent call first):
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/share/cmake-4.1/Modules/CMakeDetermineCUDACompiler.cmake:294 (cmake_nvcc_parse_implicit_info)
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/share/cmake/Caffe2/public/cuda.cmake:45 (enable_language)
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/share/cmake/Caffe2/Caffe2Config.cmake:86 (include)
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
    CMakeLists.txt:82 (find_package)

@shermansiu
Copy link
Contributor Author

The biggest challenge to overcome is that the CUDA source files are in the $BUILD_PREFIX/targets/sbsa-linux folder, whereas everything else is in the $BUILD_PREFIX folder. The same goes for $PREFIX, except that $PREFIX/bin/nvcc can't be run on linux-64. Naively copying over the files tends to break things.

@shermansiu
Copy link
Contributor Author

Okay, I suppose copying over crt is the right approach, but it seems like nvcc doesn't have any libraries loaded:

Error:

CMake Error at /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/share/cmake-4.1/Modules/Internal/CMakeNVCCParseImplicitInfo.cmake:152 (message):
  Failed to extract nvcc implicit link line.
Call Stack (most recent call first):
  /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/share/cmake-4.1/Modules/CMakeDetermineCUDACompiler.cmake:294 (cmake_nvcc_parse_implicit_info)
  CMakeLists.txt:73 (enable_language)

Value of _nvcc_output_orig:

nvcc warning : incompatible redefinition for option 'compiler-bindir', the last value of this option was used
nvcc warning : incompatible redefinition for option 'compiler-bindir', the last value of this option was used
nvcc warning : incompatible redefinition for option 'compiler-bindir', the last value of this option was used
#$ NVCC_PREPEND_FLAGS=" -ccbin=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/bin/aarch64-conda-linux-gnu-c++ -ccbin=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-c++ -ccbin=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/bin/aarch64-conda-linux-gnu-c++ -ccbin=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-c++"
#$ NVCC_APPEND_FLAGS=" -I/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs -I/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs -I/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs -I/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib -L/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs"
#$ _NVVM_BRANCH_=nvvm
#$ _SPACE_= 
#$ _CUDART_=cudart
#$ _HERE_=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin
#$ _THERE_=/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin
#$ _TARGET_SIZE_=
#$ _TARGET_DIR_=
#$ _TARGET_SIZE_=64
#$ rm tmp/a_dlink.reg.c
#$ "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++ -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -E -x c++ -D__CUDACC__ -D__NVCC__  -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"  -D__CUDACC_VER_MAJOR__=12 -D__CUDACC_VER_MINOR__=6 -D__CUDACC_VER_BUILD__=85 -D__CUDA_API_VER_MAJOR__=12 -D__CUDA_API_VER_MINOR__=6 -D__NVCC_DIAG_PRAGMA_SUPPORT__=1 -include "cuda_runtime.h" "CMakeCUDACompilerId.cu" -o "tmp/CMakeCUDACompilerId.cpp4.ii" 
#$ cudafe++ --c++17 --gnu_version=130400 --display_error_number --orig_src_file_name "CMakeCUDACompilerId.cu" --orig_src_path_name "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/work/CMakeFiles/4.1.1/CompilerIdCUDA/CMakeCUDACompilerId.cu" --allow_managed --unsigned_chars --unsigned_wchar_t --arm_cross_compiler --m64 --parse_templates --gen_c_file_name "tmp/CMakeCUDACompilerId.cudafe1.cpp" --stub_file_name "CMakeCUDACompilerId.cudafe1.stub.c" --gen_module_id_file --module_id_file_name "tmp/CMakeCUDACompilerId.module_id" "tmp/CMakeCUDACompilerId.cpp4.ii" 
#$ "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++ -D__CUDA_ARCH__=520 -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -E -x c++  -DCUDA_DOUBLE_MATH_FUNCTIONS -D__CUDACC__ -D__NVCC__  -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"  -D__CUDACC_VER_MAJOR__=12 -D__CUDACC_VER_MINOR__=6 -D__CUDACC_VER_BUILD__=85 -D__CUDA_API_VER_MAJOR__=12 -D__CUDA_API_VER_MINOR__=6 -D__NVCC_DIAG_PRAGMA_SUPPORT__=1 -include "cuda_runtime.h" "CMakeCUDACompilerId.cu" -o "tmp/CMakeCUDACompilerId.cpp1.ii" 
#$ cicc --c++17 --gnu_version=130400 --display_error_number --orig_src_file_name "CMakeCUDACompilerId.cu" --orig_src_path_name "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/work/CMakeFiles/4.1.1/CompilerIdCUDA/CMakeCUDACompilerId.cu" --allow_managed --unsigned_chars --unsigned_wchar_t --arm_cross_compiler  -arch compute_52 -m64 --no-version-ident -ftz=0 -prec_div=1 -prec_sqrt=1 -fmad=1 --include_file_name "CMakeCUDACompilerId.fatbin.c" -tused --module_id_file_name "tmp/CMakeCUDACompilerId.module_id" --gen_c_file_name "tmp/CMakeCUDACompilerId.cudafe1.c" --stub_file_name "tmp/CMakeCUDACompilerId.cudafe1.stub.c" --gen_device_file_name "tmp/CMakeCUDACompilerId.cudafe1.gpu"  "tmp/CMakeCUDACompilerId.cpp1.ii" -o "tmp/CMakeCUDACompilerId.ptx"
#$ ptxas -arch=sm_52 -m64 "tmp/CMakeCUDACompilerId.ptx"  -o "tmp/CMakeCUDACompilerId.sm_52.cubin" 
#$ fatbinary --create="tmp/CMakeCUDACompilerId.fatbin" -64 --cicc-cmdline="-ftz=0 -prec_div=1 -prec_sqrt=1 -fmad=1 " "--image3=kind=elf,sm=52,file=tmp/CMakeCUDACompilerId.sm_52.cubin" "--image3=kind=ptx,sm=52,file=tmp/CMakeCUDACompilerId.ptx" --embedded-fatbin="tmp/CMakeCUDACompilerId.fatbin.c" 
#$ "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++ -D__CUDA_ARCH__=520 -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -c -x c++  -DCUDA_DOUBLE_MATH_FUNCTIONS -Wno-psabi -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" "tmp/CMakeCUDACompilerId.cudafe1.cpp" -o "tmp/CMakeCUDACompilerId.o" 
#$ nvlink -m64 --arch=sm_52 --register-link-binaries="tmp/a_dlink.reg.c"  -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs" -cpu-arch=AARCH64 "tmp/CMakeCUDACompilerId.o"  -lcudadevrt  -o "tmp/a_dlink.sm_52.cubin" --host-ccbin "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin/aarch64-conda-linux-gnu-c++"
#$ fatbinary --create="tmp/a_dlink.fatbin" -64 --cicc-cmdline="-ftz=0 -prec_div=1 -prec_sqrt=1 -fmad=1 " -link "--image3=kind=elf,sm=52,file=tmp/a_dlink.sm_52.cubin" --embedded-fatbin="tmp/a_dlink.fatbin.c" 
#$ "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++ -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -c -x c++ -DFATBINFILE="\"tmp/a_dlink.fatbin.c\"" -DREGISTERLINKBINARYFILE="\"tmp/a_dlink.reg.c\"" -I. -D__NV_EXTRA_INITIALIZATION= -D__NV_EXTRA_FINALIZATION= -D__CUDA_INCLUDE_COMPILER_INTERNAL_HEADERS__  -Wno-psabi -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include" -I"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include"  -D__CUDACC_VER_MAJOR__=12 -D__CUDACC_VER_MINOR__=6 -D__CUDACC_VER_BUILD__=85 -D__CUDA_API_VER_MAJOR__=12 -D__CUDA_API_VER_MINOR__=6 -D__NVCC_DIAG_PRAGMA_SUPPORT__=1 "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/bin/crt/link.stub" -o "tmp/a_dlink.o" 
#$ "/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/bin"/aarch64-conda-linux-gnu-c++ -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -Wl,--start-group "tmp/a_dlink.o" "tmp/CMakeCUDACompilerId.o" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib" -L"/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/lib/stubs"  -lcudadevrt  -lcudart_static  -lrt -lpthread  -ldl  -Wl,--end-group -o "a.out"

@shermansiu
Copy link
Contributor Author

Just setting CUDA_HOME=$BUILD_PREFIX seems to work... 🤦‍♂️

-- CMAKE_CUDA_TOOLKIT_INCLUDE_DIRECTORIES: /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/include
  -- CMAKE_CUDA_IMPLICIT_INCLUDE_DIRECTORIES: /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include/c++;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include/c++/aarch64-conda-linux-gnu;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include/c++/backward;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include-fixed;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/aarch64-conda-linux-gnu/sysroot/usr/include
  -- CMAKE_CXX_IMPLICIT_INCLUDE_DIRECTORIES: /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/targets/sbsa-linux/include;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/targets/sbsa-linux/include;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/include;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include/c++;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include/c++/aarch64-conda-linux-gnu;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include/c++/backward;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/lib/gcc/aarch64-conda-linux-gnu/13.4.0/include-fixed;/home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/build_env/aarch64-conda-linux-gnu/sysroot/usr/include
-- Found nvtx3: /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/include
  -- USE_CUDNN is set to 0. Compiling without cuDNN support
  -- USE_CUSPARSELT is set to 0. Compiling without cuSPARSELt support
  -- USE_CUDSS is set to 0. Compiling without cuDSS support
  -- USE_CUFILE is set to 0. Compiling without cuFile support
  -- Added CUDA NVCC flags for:
  CMake Warning at /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/share/cmake/Torch/TorchConfig.cmake:22 (message):
    static library kineto_LIBRARY-NOTFOUND not found.
  Call Stack (most recent call first):
    /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/share/cmake/Torch/TorchConfig.cmake:121 (append_torchlib_if_found)
    CMakeLists.txt:93 (find_package)

  
  -- Found Torch: /home/conda/feedstock_root/build_artifacts/bld/rattler-build_vllm_1756707250/host_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/libtorch.so
  CMake Error at CMakeLists.txt:134 (message):
    Can't find CUDA or HIP installation.

  
  -- Configuring incomplete, errors occurred!

@shermansiu
Copy link
Contributor Author

So, it works when I run it manually with . build_env.sh && ./conda_build.sh but not when run through the script? This is weird.

@shermansiu shermansiu force-pushed the feat/add_aarch64_cuda branch from 1717ed7 to ea945cb Compare September 2, 2025 00:06
@shermansiu
Copy link
Contributor Author

@conda-forge-admin, please rerender

@shermansiu shermansiu force-pushed the feat/add_aarch64_cuda branch from 8206f73 to 4835667 Compare September 17, 2025 10:29
@shermansiu
Copy link
Contributor Author

So I do all this digging through the source code of FindCUDA.cmake just to realize that when cross-compiling, CUDA_TOOLKIT_TARGET_DIR is derived from CUDA_TOOLKIT_ROOT, not CUDA_TOOLKIT_ROOT_DIR. CUDA_TOOLKIT_ROOT_DIR is also derived from CUDA_TOOLKIT_ROOT.

Setting CUDA_TOOLKIT_ROOT was all I needed.

@shermansiu
Copy link
Contributor Author

shermansiu commented Sep 18, 2025

Funnily enough, it seems like CUDA_TOOLKIT_ROOT isn't documented. :(

Apparently, you can set it either as a CMAKE arg through -D or as an environment variable.

@shermansiu
Copy link
Contributor Author

This build will probably succeed, but let's prioritize the v0.10 builds first, as more people will probably want access to it earlier.

@shermansiu
Copy link
Contributor Author

shermansiu commented Sep 19, 2025

Depends on conda-forge/ray-packages-feedstock#211 (ray-cgraph)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants