From my experience with the steam deck:

If you're already logged in, you can use it online. But if it decides to log you out, and you're offline, then you're out of luck.

Older versions allowed you to switch to desktop mode without logging in (with broken on screen keyboard, since that's only available once you log into steam), but that option is missing in newer versions.