I'm curious about whether anyone is running this locally using ollama?
running the 7b distilled version with ollama right now.
folks over at r/LocalLLaMA
running the 7b distilled version with ollama right now.