alt Hacker NewsThis has got to be the craziest AI-shill sentence I have heard in a long time.
How can a generic LLM generate better assembly than a dedicated compiler, whose sole purpose is to generate assembly code. With people pedantically adding every optimization imaginable and unimaginable to produce the most efficient code possible. And you have the audacity to say LLMs, which write garbage non-trivial amount of time, are capable of producing better assembly.
This has got to be either a masterful ragebait, or a person with very low knowledge of modern compilers, because even an LLM would not write something so stupid as this.
Replies
One simple thing that LLM's doesn't have to do is use a calling convention. Compilers need to use them, at least to some extent because it's not known at compile time who will link against this function in the future. Humans kinda need them because it's a lot of mental load when everything is custom. But for a sufficiently smart llm, noticing a register doesn't need to be preserved because there is only two callers and neither of them care about it might be doable.
Agreed. "Evidence" in this case is a weasel word that could be anything. Misconfigured LLVM? Old/unsupported GCC target? Doesn't matter, look at the evidence of great success! This 10kb assembly loop has a 44,000% speedup versus compiling with automatic vectorization disabled!
LLMs generating "assembly that runs a great deal more efficiently" is a ludicrous claim that cannot be substantiated outside PEBCAK situations.