alt Hacker NewsThe demo they showed was full of repeated sentences. The 3B model looks quite dense, TBH. Did they just want to show the speed?
The demo they showed was full of repeated sentences. The 3B model looks quite dense, TBH. Did they just want to show the speed?
3B models, especially in quantized state, almost always behave like this.