logoalt Hacker News

anerli • today at 6:46 PM • 1 reply • view on HN

We support Vulkan as well, we just didn't mention it in the benchmark. When AMD or Strix Halo is detected the engine will use Vulkan.

Regarding model variants - our catalog includes different quantizations, and automatically assesses these against your hardware to determine which ones will fit in your memory and how fast they will run. This lets you pick a model to download based on your desired speed/intelligence tradeoff.


Replies

skohan • today at 6:48 PM

Do you have any plans to support ROCm?

➕ show 1 reply