alt Hacker NewsObciously the solution is to fight fire with fire. Spin up your own LLM and have it respond to every single point. Exhaustively. Have it ask semi-reasonable questions that must be answered by the humans.
I wager the resulting usage would drive the system costs up to the point that it would be dissembled and decommissioned. That only happens if the people behind it feel the cost personally.
You laugh, but that is exactly what I did.
I was migrating cicd from Jenkins to gh workflows for some 70-80 apps each in its own repository and support team in a random timezone. I had to open 2-3 PRs in each repo and a day or two before someone enabled "copilot reviews" in our github org.
Not only did copilot eat up all my bloody llm credits (thankfully it was almost end of the month) it created few silly comments on each of those PRs I had to respond to.
So I used an llm to write a script to respond to each of those and close them.
Also the same script wrote emails to all the teams asking for approvals, sent reminders to those that ignored it over next few days and finally merged everything in the right order.
Overall I'm a big fan of properly used LLMs.