logoalt Hacker News

Amezarak • yesterday at 6:02 PM • 4 replies • view on HN

Fake polls are not election fraud, although they certainly are a dirty trick.

Fake polls are definitely a “both sides” thing. A notorious example in the 2024 election was the Selzer poll, which was ludicrous when it was released and confirmed to be such during the actual election. 16 point misses by seasoned pollsters are not accidental. Polls generally speaking have long been used to shape public opinion and policy more than they have to actually understand the public .

Nowadays both sides are also doing what they can to manipulate the elections via prediction markets.


Replies

shagie • yesterday at 6:31 PM

Ann Selzer used a model that had little to no weighting in it and only used phone polls. This worked reasonably well in previous elections where the combination of chance and similar levels of voter enthusiasm.

It failed in 2024 when it didn't weight its model to handle differences in demographics vs the sampled population. She accounted for age, sex, and district - but not education, party identification, or past voting behavior. (The specifics of why the model failed is up for debate, but it was the same model that had been used for many years and was reasonably accurate).

From 2023, here's a description of her polling methodology:

https://www.iowapbs.org/shows/iowapress/episode/10530/j-ann-...

    But it's difficult, even I know where to look and a lot of the methodology statements get hidden or are inadequate to make that assumption. The main thing I'm going to tell you that distinguishes us from most other polling, not all, there's some very good polls out there that do what I do, which is we don't make assumptions about what that future electorate is going to look like. We let the data -- we try to get out of the way of the data showing us. So, you'll look and they'll say how they weighted the data, this that and the other, and then they include in that who the likely demographics of the 2024 caucus are likely to be. And I go, really? How do you know what that is likely to be? Or they're weighting it based on who they voted for in the 2020 election or other factors like that, or maybe they're only talking to people who have caucused before. And this approach I call polling backward, that if you're creating a model of the future, what are you going to base it on? You're going to base it on what happened in the past. And I know that things can change. So, I want to have my fingers off the data, my dirty fingers I try to keep them off the data, so it will reveal to me how that's going to go.
... And that approach failed with her 2024 poll. She weighted the overall population, but not the likely voter and it's possible that the approach was too strict.

From 2024 https://www.iowapbs.org/shows/iowapress/episode/11885/j-ann-...

    But for everybody else we keep them on the phone to get age, sex, what county they live in. That is going to give us some geography so that we can weight all of those people, I think there were 1,100 and some in our final poll, to look like the state of Iowa because that we know. And then we extract from that those people who made our likely voter screen and interviewed them. So, if they are proportionately more women who pass that screen, they are going to show up here but they are weighted at the statewide level. It's a little geeky. But one of the things I've been thinking about is with caucuses we take you if you definitely or probably will participate and maybe our screen was too tight. I don't know, there's no way to undo it and sort of check, well what would the probably people have said, because we very politely terminated the people who just said they would probably vote. But that has been our system since 2008.
➕ show 1 reply
anonymous908213 • yesterday at 6:21 PM

This is a completely baseless accusation.

> 16 point misses by seasoned pollsters are not accidental.

Not a pollster, but Nate Silver publicly challenged someone on Twitter to a $100k bet over how red Florida would go. IIRC Silver was predicting 3-5% margin, Twitterer said minimum 8%. Trump won by 14%. Even Silver, who lived and breathed analyzing polls and their reliability, made a mistake of that magnitude with his own money on the line. Sometimes the votes don't line up with polling, and sometimes the professionals genuinely don't see it coming.

➕ show 1 reply
empath75 • yesterday at 6:17 PM

The selzer poll was not a fake poll. It was an outlier. She was famously one of the best most reliable pollster in the country. Sometimes polls are just wrong just from pure bad luck and you still publish them if you trust your methodology.

specialist • yesterday at 7:18 PM

Correct, fraudulent polling is merely electioneering, chicanery, fat rucking.