logoalt Hacker News

besterman23 • yesterday at 7:41 PM • 1 reply • view on HN

Sorry I don’t mean to specifically point you out, I believe you’re being genuine.

However this comment got me thinking. Whats up with all the YC backed benchmarking companies? I know there’s only a few, but what is the business model for companies like Robocurve exactly?


Replies

computomatic • yesterday at 8:28 PM

I came across this recently and was initially surprised too. It makes sense when you consider that any company trying to build models (or an agent/value-add layer on top of a model) needs benchmarks. The best funded will do the full vertical - build their benchmarks and models together - but many will outsource the benchmark. This is particularly valuable when the dataset is difficult to compile (robotics being a prime example) - it makes more sense to let the benchmark vendor focus on that.

➕ show 1 reply