The detached head is what I meant with keeping it on the branch while not keeping it on the branch.

The complication comes from trying to stay current. With a regular worktree I could just pull, but now I have to remember the branch, fetch all and reset hard to the remembered branch.