alt Hacker NewsNow how am I supposed to develop Electron apps and use Chrome?
In all seriousness, though, as one of the uninitiated, what would be the value of hosting LLMs on a machine like this that has a lot of memory that you pay for up front versus some sort of VPC-based approach?
Replies
groundzeros2015 • yesterday at 3:19 PM
Have you seen how much GPUs cost to rent? Note that this memory is shared between CPU and GPU.
One factor is that you may not be in a position to push your working data to a third party service, for security or legal reasons.