At launch it was described as being in blocks of 128

https://openai.com/index/api-prompt-caching/