LLMs need deterministic verification to enable a quick and short feedback loop before they become really powerful. Software is uniquely positioned to provide this feedback loop. Much less in other industries.
This is entirely untrue. Go ask ChatGPT a complex tax question and decide if you need to call your accountant and spend $500 to verify the answer.
Hasn't this already arrived in the form of decision models like Jev?