logoalt Hacker News

saltcuredtoday at 3:45 PM1 replyview on HN

This analogy is ironic to me. For most people, building a dream house and verifying it means hiring someone else who is accountable for it being built to code etc.

This is exactly the naive gap that is happening with AI. There is no trusted middleman who does the verification and takes the burden of accountability. The AI vendor tries to sell it like magic but with a disclaimer that is is merely entertainment. The user tries to pretend they are reviewing, but often is just implicitly trusting the tool to do right by them on things they have no real capacity to evaluate.


Replies

unshavedyaktoday at 5:58 PM

> There is no trusted middleman who does the verification and takes the burden of accountability.

It's a great example of a project that needs accountability, but there's also thousands of other projects that need absolutely no accountability.

It's all relative to the stakes. The lower the stakes the less informed verification is needed.

The real trick is being informed enough on the boundaries to know where it matters. In the construction analogy, you need to be informed enough to know that a house is a bad idea since there are safety concerns. However building something small and non-load-bearing is probably fine to "vibe".

Eg there's no expertise needed to judge a garden trellis or 2 foot picket fence. It either works or it doesn't, and if it fails down the road there's no harm.

This boundary knowledge is the important bit imo.