alt Hacker NewsYou should mention that it is 4bit quant. Still very impressive!
Replies
elif • last Sunday at 6:07 PM
I think when you say trillion parameters, it's implied that it's quantized
You should mention that it is 4bit quant. Still very impressive!
I think when you say trillion parameters, it's implied that it's quantized
Kiki K2 was made to be optimized at 4-bit, though.