logoalt Hacker News

monster_trucktoday at 5:56 PM3 repliesview on HN

Are there any examples of this actually working? I keep seeing this fantasy repeated but have not seen a plausible explanation for how they wouldn't be contibuting to the pile of negative examples which are just as valuable if not more.


Replies

HardlyCognizanttoday at 6:35 PM

Poison pilling skills is a thing, though finding evidence for it is difficult given the crux is an absence of information. The baseline instruction and training is given to the model by the expert, but edge cases are willfully neglected. The degree of neglect generally determines how detectable it is, but if all the SMEs are in on it a lot of them will probably persist. Effectiveness and impact are obviously relative to the system and the edge case. Not particularly different from the fallout previously seen during the offshoring era.

vanuatutoday at 6:01 PM

its fantasy

scale ai's value prop was catching people like this

show 1 reply