logoalt Hacker News

binsquaretoday at 10:07 AM1 replyview on HN

Yep, there are inference stacks where it just does not work without cuda in any meaningful performance


Replies

DiabloD3today at 11:08 AM

Weird, since the most used open source inference engine is faster on Vulkan on platforms that offer multiple options, with the sole exception being Nvidia, due to poor Nvidia driver quality (which I am forced to assume is intentional, Nvidia wishes to maintain their moat after all).

show 1 reply