CUDA for AMD on Windows

Off-topic and somewhat of a rant, but I'd far prefer us all focusing on open standards like HIP, SYCL, OpenCL, etc.

It's unbearable that most LLM inference happens on closed H/W, closed drivers, and closed SDKs.

I made cuda-metal btw (for mac kek), https://github.com/lulzx/cuda-metal

I wish there were a way to use RDNA1 cards with CUDA for AMD. My 5700XTs are sitting in a drawer.

CUDA for AMD on Windows

I’ve been working on a Windows setup that lets CUDA-targeted applications run on AMD GPUs using ZLUDA + ROCm/HIP.

Repo: https://github.com/Speedstu/CUDA-for-AMD-Windows

So far, it has only been tested on my RX 9060 XT (gfx1200), where I’ve used it with CUDA-enabled LibTorch workloads, including long ai training and use.

I also added a GPU scanner / auto-detection system that detects:

AMD GPU model

gfxXXXX architecture

ROCm/HIP installation

driver info

whether the GPU has already been validated by the project

Example:

RX 9060 XT → gfx1200 → RDNA4 → HIP detected → validated

The goal now is to test it on more hardware, especially RX 6000 / 7000 / 9000 cards.

If you have an AMD GPU on Windows and want to try it, I’d really appreciate compatibility reports working or broken. There’s a dedicated GPU compatibility issue template in the repo.

If this is useful to you, a star would also help the project get more testers.