>I also can't cleanly nest and stack GUI applications in tmux like I can with TUI programs.

Sounds like a window manager problem