People do use textbooks like that all the time in the experimental setup tested (essentially an open book quiz).

I agree there are important differences in how textbooks and LLMs are used in real life. This study didn't explore that at all. It used a setup that essentially elided the difference between the two.

This is why I think it's a bad study. It didn't measure anything of the essential differences of how people use LLMs.

> You could make the point that it’s no different than the textbook example you gave, but people don’t generally use textbooks like that

Feels like this differs wildly depending on who you consider "people" to be. The average person on the street? Definitely just parrots stuff they've read somewhere, not even a "textbook". A group of software developers used to parsing semi-true information? Probably they'd get it right, yeah.