alt Hacker NewsIdk man my system design game is better than its ever been because I put in the effort to use these tools and recognize they can't do software design better than I can and because I've increased the scope of what I'm building I often have to think more deeply about the problem up front. A typical speccing sessions lasts a few hours for me on big work before I have AI start writing that work where I'm just going back and forth on what I want, points of consideration for performance, usability, structure etc pushing back on where AI (always) chooses the most naive way it wants to do something.
Every time I see an anecdote like this, A it reaffirms my belief that FAANG devs are fairly mediocre on the whole (not saying this is you, obviously there are good FAANG devs) and B it reaffirms my belief that the developers who kind of give up their thinking like this are really using the tool wrong or didn't really care about the work before AI either so its now just a quick means to an end.
Replies
> Every time I see an anecdote like this, A it reaffirms my belief that FAANG devs are fairly mediocre on the whole
I think another (partially causal?) problem is how they're managed. The whole perf circus is just ridiculous, especially the stuff recently reported about facebook. But they're all more or less like that. Steeped in that cocktail of incentives, who even knows what might happen to an otherwise excellent engineer.
But also just numerically, they can't be much above average, on average, because there are so many.
I strongly believe that you cannot evaluate how good a system design is if you don't implement it by hand.
LLMs will implement what you ask them to, even if it is the wrong approach. They can be lazy and take shortcuts all the time, but they do not feel PAIN (obviously they don't feel anything and aren't lazy, I'm just personifying them but you get the point). Only when you implement by hand can you feel if the implementation of your design is painful or not, and only this signal can tell you if your design if truly good or not.
I do think LLMs are useful for design work, they are good at asking clarifications and probing questions which actually do push you to approach problems differently, but leaving implementation of designs to LLM is a recipe for disaster, and judging your own design skills when you're not implementing such designs is seriously laughable. And to be clear, it already was before LLMs, when "software architects" were just designing and then had peons implement for them.
LLMs are enabling a whole new level of bad code that is best describe by the following Jurassic Park quote: “Your scientists were so preoccupied with whether or not they could, they didn't stop to think if they should.”.
> A it reaffirms my belief that FAANG devs are fairly mediocre on the whole
Off-topic but having worked in other companies as well, I can guarantee you that this is not the case. The skill of engineers in FAANGs and other "top tier" companies is much higher than average.
+100 on this. In addition, if you don't outsource your thinking and you're willing to go through all this, you absolutely don't need the top tier models.