logoalt Hacker News

NoDodgeQuestiontoday at 5:42 PM4 repliesview on HN

How can system be tuned for a specific model? Model is fungible, often one model strictly greater on both quality and price.


Replies

seizethecheesetoday at 5:54 PM

Think of it this way: you are at an enterprise business. You have a workflow implemented a year ago that is working just fine. Swapping out the model for a new one changes behavior in unpredictable ways. Eventually, you'll do it once cost is low enough, but it takes serious labor to validate this, so you'll wait a long enough time for Google to make money.

show 1 reply
nickservtoday at 5:49 PM

Prompts can certainly be tuned to a particular model, where updating the model actually results in worse performance. This is perhaps less true today than a year or two ago, but we have seen this on newer models as well. Typically, the less specific the instructions are, the less it's a problem. But sometimes you really need to get into specifics to get good results. Area of work is code porting and translation.

ipsodtoday at 5:44 PM

Models are not fungible, if you're building certain types of products on them.

show 1 reply
andaitoday at 5:53 PM

The business model is to replace the entire human economy.