This isn't quantized, right? Just a smaller context?
Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized.
alt Hacker News
Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized.