alt Hacker NewsWhy is there still a hard VRAM requirement that's dependent on the model size? Isn't that exactly what this project is supposed to solve?
Why is there still a hard VRAM requirement that's dependent on the model size? Isn't that exactly what this project is supposed to solve?