logoalt Hacker News

kodoman • today at 8:32 PM • 0 replies • view on HN

I think it has changed everything and in all honesty it has been the biggest change since the introduction of high level languages (As in from Assembly to C and Algo).

but at the same time I think the companies are pumping this idea that SWE is over and stoking anxiety and we have yet to see how bad things get when everyone can write software without thinking about it, we will see what insecure slop gets produced and it's going to be huge.

The issues with AI security are quite big as well, people who will rely on just an LLM to be the intelligence will get burnt I am sure especially in operations, prompt injection is still an issue, would someone running LLM's notice an provider endpoint getting hijacked and acting maliciously and inserting malware into production servers.

The future is going to be a strange one for sure but being able to turn your brain of and get your LLM to run you servers write you servers is not going to work alone.

I have also yet it write a good fairly novel program without babysitting (quite trivial babysitting sometimes) but stuff that is bread and butter for us, for those who don't have those skills, will they really know how to explain the issues they may run into that requires creativity, for example telling it to hack something together with curl and jq, knowing why a certain thing with the sandbox is not working.

I think these issues are not as easy to resolve with just better tooling and they will soon get annoyed at prompting.

Additionally I think Gas Town shows the sort of almost mentally ill mentality that is baked into some of these tools and ideas, Everything I read of Gas Town was so strange and the amount of tokens used to anthropomorphize agents.