logoalt Hacker News

tantaloryesterday at 8:33 PM4 repliesview on HN

The human baseline seems flawed.

1. There is no initial screening that would filter out garbage responses. For example, users who just pick the first answer.

2. They don't ask for reasoning/rationale.


Replies

slongfieldyesterday at 8:54 PM

My favorite example of this was the Pew Research study: https://www.pewresearch.org/short-reads/2024/03/05/online-op...

They found that ~15% of US adults under 30 claim to have been trained to operate a nuclear submarine.

felix089yesterday at 8:56 PM

RE 1, they actually do have a pre-screening screening of the participants in general, you can check how they do it in detail: https://www.rapidata.ai/

show 1 reply
andreasglyesterday at 8:48 PM

I agree. I wonder what the human baseline is for ”what is 1 + 1” on Rapidata.

show 1 reply