> This is the opposite direction AI should be going.
There is no moral obligation, in any domain, to refuse to make a product that adults, with full informed consent, find useful and purchase. Who are you to say you know better than the market?
Markets only work in well-regulated environments, this has been known since forever (Adam Smith).
There is no meaningful competition in a marathon if I can drive you over with a car at the first 100m.
And thanks fkin God that we have regulations and meaningful laws and some asshole for-profit company can't just put drugs into food.. the "informed buyer" is bullshit. Humans are faulty, and there is a billion dollar industry meant to take advantage of said faults: it's called marketing.
Market conditions are not a moral standard either, nor do they represent any cohesive one in particular. Not sure why you're contrasting their opinion with this, it's literally no better.
I disagree. I think you absolutely have a moral obligation to consider the impacts of your product.
> Who are you to say you know better than the market?
You really don't think the scientists & engineers making these tools know some things better than the market?