Another llama.cpp and mistral.rs? If it support vision models then fine, I will try it.
EDIT: Looks like no L3.2 11B yet.
It supports the PHI 3.5 vision model since yesterday actually.
I think a 11B model would be way too slow in its current shape though.
alt Hacker News
It supports the PHI 3.5 vision model since yesterday actually.
I think a 11B model would be way too slow in its current shape though.