logoalt Hacker News

tchallatoday at 4:18 PM1 replyview on HN

> The ability to generalize isn’t just about being general purpose, it’s super robust

I work with LLMs daily. 5 of my specialized tasks are outperformed by a custom model than a general purpose frontier model. The performance of my custom models not only beat them but are orders of magnitude low in costs and thus are able to be used by more customers.


Replies

verdvermtoday at 4:43 PM

I suspect you and GP are talking at different layers. I think you are using robust on specific tasks with measurable confusion matrix. I think GP is talking about robust in more complex and diverse workflows, with the ability to self correct over turns.

Either, please correct me if I'm misinterpreting