NeoVim docs say it defaults to "$XDG_STATE_HOME/nvim/undo//". Do you have a source for ~/.cache?
=> https://neovim.io/doc/user/options/#'undodir'