logoalt Hacker News

uptrails • yesterday at 7:13 PM • 2 replies • view on HN

I've done some work in this space and it's mostly that Big Tech has regulators and parent advocacy groups already very angry with them and breathing down their necks, so they would rather lose customers than take a nuanced approach. The marginal value of having you as a customer is approximately zero, the regulatory risk of letting CSAM through is huge.

Another complicating factor is that it really blows to have humans look at stuff like that, so everyone would rather use automated classifiers; and if you assume good faith and share too much info with the affected parties, this will be exploited by the bad guys to gain insights into how the system works and how to circumvent it.

I don't think there's an elegant solution to this, other than "don't allow tech companies to get so big that they can afford not to care about individual customers".


Replies

methodical • yesterday at 10:06 PM

I'm unsure if there's any particular size requirement for a company to not care about individual customers. Barring an exceedingly small amount of businesses who rely on a handful of customers for their entire bottom line, probably almost all B2C and most B2B companies have a certain point at which any particular customer is simply not worth the overhead to serve. For OAI I would assume anything that even smells like CSAM is probably more than enough for them to justify acting first and (maybe) asking questions later, especially with the regulators and IPO to consider.

deaux • yesterday at 9:20 PM

> I don't think there's an elegant solution to this, other than "don't allow tech companies to get so big that they can afford not to care about individual customers".

On the contrary, that's an incredibly elegant solution.