Unsloth studio, on a server that I built in 2024 that was, at the time, ludicrously oversized, but is now just ok-sized to run the q4 quant of qwen flash next. (128GB ram, 16GB vram).
I really want to build something less scuffed, but, yknow. So I'm making do atm.
Unsloth studio, on a server that I built in 2024 that was, at the time, ludicrously oversized, but is now just ok-sized to run the q4 quant of qwen flash next. (128GB ram, 16GB vram).
I really want to build something less scuffed, but, yknow. So I'm making do atm.