alt Hacker NewsBenchmarks can get costly to run- you can reach out to frontier model creators to try and get them to give you free credits, but usually they'll only agree to that once your benchmark is pretty popular.
Replies
epolanski • yesterday at 3:50 PM
The last thing a proper benchmark should do is reveal it's own API key.
➕ show 2 replies
mohsen1 • yesterday at 3:23 PM
yes I reached out to them but as you say it's a chicken-and-egg problem.
Thanks!
so basically they know requests using your API key should be treated with care?