Skip to content

Run inference on newer hardware (RTX 5080) #19

@MrPio

Description

@MrPio

I am unable to setup the environment as explained in the README.md as it installs a version of PyTorch that is incompatible with my CUDA.

NVIDIA GeForce RTX 5080 with CUDA capability sm_120 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_37 sm_50 sm_60 sm_70 sm_75 sm_80 sm_86.

However, I was able to solve with two minor changes:

  • patch_t=128 instead of 160, otherwise, the positional embeddings have shape (1, 10, 128) instead of (1, 8, 128) as in the checkpoint.
  • in SRDTrans/MainFrame.py, SqueezeLayer::forward, I changed before_down = self.conv_net(x) to before_down = self.conv_net(x.float())

Now the inference works fine on Python 3.12.3, torch (2.9.0+cu128).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions