alt Hacker NewsPlenty of good answers were rejected, especially where typos were concerned. On the coffee shop question, CK's coffee shop wasn't found and Waffle House was rejected, but Paul's was a top answer? Paul's also serves breakfast food. Seems arbitrary. Memphis Colosseum was rejected probably because the proper spelling is Coliseum. But how could it not find it from "Memphis Colosseum"? It's easily found (and the spelling corrected) in Google Search.
Hey, thanks a lot for the feedback! Most answers are first checked against a fixed list, to avoid making too many LLM calls. Unfortunately, for latency and playability reasons, we can't do much deeper online searches: every call would cost a lot and take too long. So about 1 to 1.5% of answers end up judged a bit unfairly, but we're actively working on improving the model. Thanks again for your feedback!