Nvidia buys the memory it uses on its GPUs, same as all other ASICs.

To give some context, Intel started making DRAM, I think they were actually the company that came up with modern memory techniques. They exited the market and pursued a more lucrative moat with CPUs.