logoalt Hacker News

kmac_today at 2:13 PM3 repliesview on HN

About one year ago, I created an LLM gateway with metrics, provider fallback and switching, tools support, injecting, etc. etc., and unique features like acting as an MCP tools client and server, all streamed, with low latency.

It was a simple project in terms of technical complexity. I didn't publish it as I counted several similar projects in the field.

Putting $7.3M into such a project would make sense only in the case of a precise growth plan with already declared customers and an promising sales funnel. There is no technical moat.


Replies

jnovektoday at 2:40 PM

The calculus in “buy or build” has shifted for me over the last six months especially. If I can make an agent build it, I get the version that’s tailored for me.

> It was a simple project in terms of technical complexity.

That’s the thing, though. The version I build for myself sheds all the features that get in my way. I don’t share them either because they’re only useful for me.

Perhaps in the future big tech projects will be delivered with a common “core” and the expectation that agents fill in the use-specific stuff.

show 2 replies
zackifytoday at 2:25 PM

That's literally every project around AI. All the agent sandboxes. Hosting cron jobs that just hit ai rest endpoints for model completions etc

knightops_devtoday at 4:15 PM

[flagged]