Yeah. Having a model of the signal flow in your mind and being creative with the structure is half the fun of synthesizers for me. And even if you don't comprehend everything in the moment, happy accidents are a big part of the fun.
Some modular performers like Keith Fullerton Whitman have a very dynamic approach to patching. I've seen shows where he was aggressively re-patching throughout the performance and hot-swapping connections on the fly. I'm talking several patches in a minute. It wasn't subtle, either. It was a nice contrast to many performers who tend to design their system as a fixed structure and then play from there.