I agree, and the very low price of used books that have writing in them, suggests that this is how people feel in general.
I have begun to write a page (by hand) summarizing my thoughts after reading a book, and put it in the start of it. That was a tip I saw on HN some time ago.