Agree on all accounts. I very much enjoy the limited woodworking I've done, but the logistics are much trickier than knitting.
I do find whittling to be an interesting middle point. Like knitting, you don't need a dedicated workshop. It doesn't take a lot of set up and tear down for a given session. You can fit the project and tools in a small space.
Of course, you're shedding wood chips the whole time, so you can't really whittle on the couch. And you sure as hell can't do it on an airplane. But you can do it when, say, camping with friends, or sitting on the back porch when it's nice out.