Yes. The memory is just located very close to the cpu with wires "welded" directly to it. This allows the memory to be run as fast as possible but it's still a RAM component.

The cache parts of memory are on the CPU itself but they are on the order of MB not GB.