alt Hacker Newsthe problem is the dsv4 checkpoint so quantized isn't very good
Replies
c0rruptbytes • today at 9:38 PM
not my experience
the ds4 quants were very good beating the unsloth quants https://github.com/michaelasper/benchmarks/blob/main/deepsee...
➕ show 1 reply
Which ds4 checkpoint for which model exactly did you test? Don't they have multiple different versions and quantization levels?