The critical part of software engineering, verifiability and correctness, is still something AI cant do properly at all. And by that i dont mean testing software against a test suite, i mean making a good and extensive test suite to build software against

Given that, the farmer or vibe coder is still going to have to take responsibility for making sure the software is verifiable and correct. Thats a heavy responsibility with a huge peice of machinery like this, its naive to equate that with making sure your todo list app or even c compiler works.

The economic calculus still means its better for an corporation to take on that responsibility, and be compensated for it. Now we just need that corporation to not be rent seeking dicks, and we could have a good thing going

Aside from the legal question whether the manufacturer allows you to do so, I’m pretty excited about somebody vibe coding firmwire to a 35 ton machine with a bunch of big attachments at the back and plenty of ways to mangle the bodies of careless operators without the rpm so much as audibly rising from strain. Should give us plenty of videos to traumatize the next generation of children with a little bit too much internet access at an early age. I feel nostalgic for those days.

(This is sarcasm, pretty please don’t vibe code car firmware, let alone anything more dangerous than that)

What a great idea! what could possibly go wrong allowing farmers with no expertise in writing firmware for gigantic farm equipment, overseeing code output from an LLM and then uploading it to the aforementioned gigantic farm equipment?

Let's just ignore the part where this wouldn't even address the problem at hand!

That’s not what this is about, it’s about access to dealership level diagnostic software.

But you don’t have to wait for the farmers, you could “get Claude to code an entire car software and flash it onto your own hardware and put it in your car.” Post back here with your results!

1. Yes 2. Maybe, probably not though. It's complicated 3. No

Half the process of jailbreaking electronics involves reverse-engineering. There's some promising work in that direction, but reverse-engineering is still not AI's strong suit.

Also, you'll actually need to hook up Claude to all the debug interfaces and pins present on the chip you're trying to break.

Also also, if this worked at all the feds would put a gun to Anthropic's head to make Claude refuse to do anything that might break DMCA 1201.

Law is code.