alt Hacker NewsI’m one of the contributors to Mesh LLM and happy to answer any questions. I authored the skippy engine that allows you to split large models across nodes.
I’m one of the contributors to Mesh LLM and happy to answer any questions. I authored the skippy engine that allows you to split large models across nodes.
This is super impressive, We have a lab with lots of different epycs and different models - to bring them together this way is amazing. Well done!