logoalt Hacker News

hobofantoday at 7:08 AM1 replyview on HN

Most places I know that have strict on-premise/air-gap requirements are just investing in on-premise AI and open source harnesses instead. The only ones that don't are the typical places that are slow to adopt technology in general (usually because they can afford to due to historic moat).


Replies

sublineartoday at 7:53 AM

Most places that must do things on-prem also have strict requirements and long deadlines.

LLMs can be nice sometimes, but not necessary. Internal teams with "not invented here" syndrome currently working on that stuff are ultimately wasting money until the dust settles a bit more.

Those long deadlines have nothing to do with implementation. It's the game of telephone and accountability bottlenecks. You still want to retain your most experienced devs and give them plenty of time to work. Writing the code was never the bottleneck. A good dev team has balanced experience of the business and the code, not just the code, and certainly not the kind of code an LLM generates. Most of the decisions by those devs happens outside the codebase.

show 1 reply