FWIW: GDDR is not higher latency than DDR. It just seems that way because the GDDR interface clock is much higher, so the number of clocks are higher too. But in terms of wall clock time, the latency is very similar.
Which makes sense: the latency is determined by the underlying storage technology and the way to access that storage, which the same for both.