logoalt Hacker News

romaaeternalast Sunday at 7:52 PM0 repliesview on HN

Running the first question as a test against mradermacher's GGUF of the 20b heretic fails when running llama.cpp as Q4_K_M, but successfully generates the tutorial with larger better quality Q8_0