How did you do your setup ?, right now the only way i know how to run LLM is through LM studio.
Using tabbyApi and exLlamav2.
Using tabbyApi and exLlamav2.