alt Hacker NewsNot sure a model that small is really supposed to be used for any real coding. At that size you're usually using the model to do simple tasks like summarization.
Not sure a model that small is really supposed to be used for any real coding. At that size you're usually using the model to do simple tasks like summarization.
To be clear, the question wasn't a complex one. It was more on the level of "could I use this for a fast inline coder" IE, single somewhat simple function question.
I wouldn't have dreamed to use this as an agent model.
7B models of the past have been able to pass this question. I've not tested it on a 4B model until now.