logoalt Hacker News

vatsachakyesterday at 9:40 PM3 repliesview on HN

Something like building Linux is more akin to managing a McDonald's than it is to a 10 page technical proof in Algebraic Groups.

Programming is more multimodal than math.

Something like performance engineering might be free lunch though


Replies

hodgehog11yesterday at 10:52 PM

> Programming is more multimodal than math

I have no idea how you come to this conclusion, when the evidence on the ground for those training models suggests it is precisely the opposite.

We are much further along the path of writing code than writing new maths, since the latter often requires some degree of representational fluency of the world we live in to be relevant. For example, proving something about braid groups can require representation by grid diagrams, and we know from ARC-AGI that LLMs don't do great with this.

Programming does not have this issue to the same extent; arguably, it involves the subset of maths that is exclusively problem solving using standard representations. The issues with programming are primarily on the difficulty with handling large volumes of text reliably.

show 2 replies
slopinthebagyesterday at 9:48 PM

Yeah, it's hard to compare management and programming but they're both multimodal in very different ways. But there's gonna be entire domains in which AI dominates much like stockfish, but stockfish isn't managing franchises and there is no reason to expect that anytime soon.

I feel like something people miss when they talk about intelligence is that humans have incredible breadth. This is really what differentiates us from artificial forms of intelligence as well as other animals. Plus we have agency, the ability to learn, the ability to critically think, from first principles, etc.

show 2 replies
bitwizeyesterday at 10:12 PM

But LLMs have proven themselves better at programming than most professional programmers.

Don't argue. If you think Hackernews is a representative sample of the field then you haven't been in the field long enough.

What LLMs have actually done is put the dream of software engineering within reach. Creativity is inimical to software engineering; the goal has long been to provide a universal set of reusable components which can then be adapted and integrated into any system. The hard part was always providing libraries of such components, and then integrating them. LLMs have largely solved these problems. Their training data contains vast amounts of solved programming problems, and they are able to adapt these in vector space to whatever the situation calls for.

We are already there. Software engineering as it was long envisioned is now possible. And if you're not doing it with LLMs, you're going to be left behind. Multimodal human-level thinking need only be undertaken at the highest levels: deciding what to build and maybe choosing the components to build it. LLMs will take care of the rest.

show 2 replies