logoalt Hacker News

wanderlust123today at 2:16 PM3 repliesview on HN

What is this real difficult stuff you speak of that only you can do and LLMs can not?


Replies

beej71today at 2:27 PM

I don't have a concrete example, but it's probably the stuff that starts taking longer to describe in English than to code.

"Make me this thing there are a million examples of" vs. "make me this unique thing in this exact, particular way".

I don't think there's anything an LLM can't write given enough direction. (It's a one-sentence fuck-it one-off on one end of the spectrum, and it degenerately ends with you giving it exact code and prompting it to echo it back to you on the other.)

But the jobs of making basic apps and web pages are the new WordPress jobs in terms of pay, I'd agree.

show 1 reply
sampullmantoday at 2:20 PM

Write a decent comment, for one. It struggles with some of the firmware stuff I do, though that's more due to a lack of a proper automated feedback loop.

show 1 reply
embedding-shapetoday at 4:06 PM

Two recent examples I tried to get Sol/Opus to get help with, were they gave more misdirections than beinghelpful: Tracking down the root cause of a synchronization bug in a distributed platform using CRDTs, especially dumb around sequence CRDTs. Also had less fun using Sol/Opus for building and troubleshooting fractures and constraint networks in Houdini.

I'm sure these will be much better as soon as enough data is in the training set, as always. GPT models used to be horrible at electrical stuff as well, today Astra seems pretty OK at it. It changes as they keep extending what use cases are covered by training data and what they test for and so on.