logoalt Hacker News

calcsam02/19/20252 repliesview on HN

Yeah, this is something we've heard as well. No particular feature right now but we did ship an agent in local dev to help people improve their prompts.


Replies

Gakho02/19/2025

I'm wondering since there seem to be a lot of frameworks/websites that support evals, even OpenAI has evals.

Do you think that a lot of these components like observability and evals will eventually be consumed by either providers (like OpenAI) or an orchestration framework like Mastra (when using multiple providers, though even if you're using just one provider for many tasks I can see it belonging to the orchestration framework)?

show 1 reply
swyx02/19/2025

link to this agent?

show 1 reply