> I'm under the impression everything is CUDA

A very quick Google search would show that pretty much everything also runs on ROCm.

Torch runs on CUDA and ROCm. Llama.cpp runs on CUDA, ROCm, SYCL, Vulkan and others...