logoalt Hacker News

ford • today at 2:53 PM • 3 replies • view on HN

You're better off going directly to artificial analysis, this is a feature-poor/misleading/outdated repackaging

Ex. this type of price estimation is quite naive - some models can require 2-3x the number of tokens to achieve the same level of intelligence. Artificial Analysis' own cost per task is a more fair estimation of cost.


Replies

mosselman • today at 5:49 PM

Exactly. The only metric you need to look at is the cost per task and take your pick from the models that match your budget there.

Spark is such a bad model, you are far better off using Astra Medium than using Spark.

mpalczewski • today at 4:41 PM

The analysis might be better on Artifical Analysis' however the way the information is presented by terrydjony is so much better. I'm able to get the exact actionable info I want. Whereas on artificial Analysis I'm analyzing and figuring it out.

It's the equivalent of ai slop writing in a data format.