alt Hacker NewsDefinitely Unsloth Studio can help - we recommend specific quants (like Gemma-4) and also auto calculate the context length etc!
Definitely Unsloth Studio can help - we recommend specific quants (like Gemma-4) and also auto calculate the context length etc!
Will have to try it out. I always thought that was more for fine-tuning and less for inference.