alt Hacker NewsWhat type of task are you running for ten hours? Is this a programming task?
I've not come across a programming task that would take an LLM ten hours.
What type of task are you running for ten hours? Is this a programming task?
I've not come across a programming task that would take an LLM ten hours.
I'm not the person you asked, but if they're running in their own local hardware, then it might just be a lot slower than what the big providers run their models on. System RAM is a lot cheaper than VRAM, especially if you bought it last year.