logoalt Hacker News

eriestoday at 5:53 PM0 repliesview on HN

Yes, I do think this is something that LLMs should be very good at. As I've said in a couple of the comments in the thread, summarizing is LLMs' greatest superpower. But I have a whole chapter in the book about the use of metrics and, of course, their misuse. I'd be very cautious here. Government reformers have often assumed that just having better data will cause agencies to make better decisions, but this is simply not true. The choice about which data to pay attention to, whether to make decisions in a scientific or humane way, are values questions, not just data questions. They require the installation of a specific ethos in the organization to stay true to those values. Without that, more data will not have any effect whatsoever.