Isn’t 200 tokens basically nothing? Did you mean to say 2000?
That's indeed short for some actual uses such as summarization, but AFAIK many/most? evals involve generating less than 200.
alt Hacker News
That's indeed short for some actual uses such as summarization, but AFAIK many/most? evals involve generating less than 200.