logoalt Hacker News

Gakho02/19/20251 replyview on HN

I'm wondering since there seem to be a lot of frameworks/websites that support evals, even OpenAI has evals.

Do you think that a lot of these components like observability and evals will eventually be consumed by either providers (like OpenAI) or an orchestration framework like Mastra (when using multiple providers, though even if you're using just one provider for many tasks I can see it belonging to the orchestration framework)?


Replies

calcsam02/19/2025

I could be wrong but don't think OpenAI wants to be opinionated about that, except maybe the OpenAI solutions engineers :)