alt Hacker News> Abanca is using agent orchestration to handle sensitive customer information at a huge scale (2 million customers in their app).
Maybe my perspective is skewed on what "huge scale" means, but 2 million users? That's like a few hundred megabytes of data? Or a couple GBs if there's a lot of per-user data?
Replies
fidotron • today at 5:47 PM
European consumer focused businesses do not scale easily the same way US ones do, which is a major contributor to their problems developing tech businesses generally.
OTOH such things can be quite defensible, they just rarely become anything like as profitable.
Maybe, but using state-of-the-art large language models to solve customer support queries with agentic can quickly use a lot of tokens. What I understood from the talk is that they used agents with limited responsibility and (assumption from me) smaller models, to the make sure the answers were quick, reliable and not too costly.