> Thinking that computer software must be exempt from that mess as a goal is just strange
Software is deterministic, it has been since its inception[0]. Why go from something objective/provable to something that does "strange things", when we already have former? It's like making bricks out of paper and declaring "actually, this is logical next step for bricks because stuff waves in the wind".
> What if our lives get much, much better?
What if not?
[0] (Yes not really/actually if we're being pedantic)
Here is a simple and possibly clarifying thought experiment: Would you be willing to switch your standard of living with the standard of the median person living on this planet? (And I would urge you to look up what that looks like, in case you are unsure).
As long as you are not (and I sympathize) I have zero clue how to justify any delay in getting everyone at least to our current level.
I understand that there are risks and we should work hard to guard against them. But no society has seriously considered giving up driving while we figure out global warming. People want a good life, that's just the selfish fucks we are, and it's upon those with clout to will it for everyone.
> Why go from something objective/provable to something that does "strange things", when we already have former?
Because it does something different. It's not from/to. LLMs are subbing in for humans, not for deterministic computing. Replacing deterministic computing with LLMs for tasks that have be perfectly solved without LLMs would be wasteful and silly.
> Why go from something objective/provable to something that does "strange things", when we already have former?
Because we like computers to feel like they are fast, mainly. Most compilers, for example, are non-deterministic because they can be made to run faster if they ignore things like thread execution order. Same goes for LLMs. Technically they are as deterministic as any other software, but we allow GPUs to play fast and loose with floating point numbers to speed things up, which gives the impression of "strange things".