alt Hacker NewsOnly a few curmudgeons at this point are claiming there is nothing, nothing whatsoever, to AI.
The question is really about the fate of the current build out. For those of us who have extensive experience with AI, which is to say, those of us here, because we are probably the only people not only using it day in and day out but potentially using multiple sessions of it all the time, I think it's not so surprising that it isn't necessarily immediately radically transforming every industry everywhere. Even as it has rewritten the minute-by-minute process of doing my job entirely, it hasn't actually changed my job all that much at the higher level and it's hard to assign much more than a 2x or a 2.5x overall improvement to it once I account for all the Amdahl's Law issues that come up from the parts that have not been so amenable to acceleration.
And without unit testing, continuous integration testing, pull request review, the fact that the AI is building code which is itself a highly reviewable artifact rather than just doing whatever directly, and all the many many guard rails we've built up in our industry that happen to be extraordinarily amenable to use by automated systems, I still wouldn't trust AI all that much for a real task. They still bang into those guard rails a lot, and still make what I consider to be deeply suboptimal decisions far too often to take my hands off the wheel. With all the stuff we have in the programming space they are a game changer, but in a field that doesn't have anywhere near that much padding and safety nets I'd be way, way more hesitant.
I want to say it's weird to talk about such things when they are also capable of such amazing math proofs, but at the same time when you consider the numbers tossed around for how much those things have cost, I think you're seeing another space that has guard rails comparable to software engineering. By contrast to the way these AIs are working, when a human solves a comparably hard problem the human tries a few things but from the outside would seem to proceed almost directly to the solution, compared to the staggering amount of blundering about the AIs do before arriving at their solutions. Now, in terms of the final results, yeah, they got there and I won't deny that. I'm just saying that in fields where the acceptance criteria are nowhere near as sharp as math or software, they're operating at a significant disadvantage still.
Replies
> I think it's not so surprising that it isn't necessarily immediately radically transforming every industry everywhere.
Computers and the internet didn’t radically change every industry everywhere. But every industry everywhere uses computers and the internet, and more pertinently, they pay good money for it.
AI doesn’t need to transform the world, it just needs to pay off the sizeable investments in data centers.
I think there's also something to be said about how the largest private AI enterprises are themselves mostly just software companies. There is enough widespread dogfooding of the product that the company staff are not just spending a lot of time and energy in improving how their product is specifically adapted and trained for better code but they are also intimately aware of those limitations, driving how they think about and implement their own product.
I don't think that translates well for other fields at all. You can throw an engineer or an MBA-brained exec at a business problem all you want but until they start using the products, they're not going to be effective at guiding its development.
In a way it’s sad that AI came in the age where a lot of us are jaded because the internet which we built has become a place for gambling and scamming. I remember when a new language or framework was met with excitement. Today I hear (and am a source of) mostly criticism.
Math is just proof of concept for the big players. The same resources could go to prompts designed to optimize the internal combustion engine or anything else nonsensical.
The biggest paradigm shift has been representing models as humans, and I don’t think that’ll fade. I highly expect the AI Model T Ford will be a generalized assistant that actually works. Likely developed by OpenAI or Anthropic. And likely 5 years from now or more.
> I still wouldn't trust AI all that much for a real task
I wonder if you might be conflating LLM/Agent with AI
Waymo is AI, I personally would happily ride one, or a Zoox. Those are quite real tasks the AIs are performing, people put their lives on the hands of these AIs
A lot of AI models every day work to provide search results, driving directions, image recognition, automatic routing and classification (eg. Fruit packaging companies use vision models to accept/reject fruit for packaging in real time - that’s the fruit we buy at the supermarket and then eat at home), and so many other things
So inadvertently, and without much choice either, you probably already rely and depend on AI on your everyday life