You absolutely can exit Emacs by clicking a button! Even when it is running in terminal. You just need menu-bar-mode (which is enabled by default) and enabling xterm-mouse-mode (which also should be enabled by default) - https://asciinema.org/a/rprH0gLSkrUz2cqr