alt Hacker Newsday one support for all inference engines so that whichever kind of capable computer you have, you can run it. you do need a really capable computer though
day one support for all inference engines so that whichever kind of capable computer you have, you can run it. you do need a really capable computer though
> you do need a really capable computer though
They suggest a pair of Mac Studios w/ M5 Ultra chips and 512 GB of RAM. A single Mac Studio w/ M5 Ultra and half that RAM (256 GB) is around $11k, and the 512 GB option isn't even available yet. So.... yeah.