alt Hacker News> why we are using generative models for categorization and extraction
Because LLM models have already amortized the man-years cost of collecting, curating and training on text corpuses?
> why we are using generative models for categorization and extraction
Because LLM models have already amortized the man-years cost of collecting, curating and training on text corpuses?
Yeah, LLMs are a solution to the cold start problem plus they are easy to integrate and if you know what you're doing in terms of evals, post processing and so on you can get excellent performance out of them, plus they can do semantic classification and reasoning that you won't get out of some bespoke traditional DS/ML model.