alt Hacker News> I mean, sure you can blame Google Maps, but it wasn't my choice to consult Google Maps.
Okay but isn't that obvious that's what would happen? Like even if you ask a human, that's where they will consult and if it shows its open, it doesn't really have any incentive to question the validity of the data.
But more so, it is on the management of the place as well that they have a Google My Business Page but do not update it. If they say its open, why would Google Maps mark it as closed? If it's marked as open on Google Maps, why would Gemini Flash Lite refute that?
Blaming the LLM for this makes little sense imo. Sure it's a dumb model but in this case, it was set up to lose.
The point is that it got to the right answer eventually, which conceivably it could have done at the first step:
1. Open on Google Maps?
2. Validate no extra notices posted on their public website
Even the fact that there is are special notices sometimes posted on their public website is something a model could have been trained to understand, same as a human being.