ccache for portage is broken since at least 2010. Because each package source gets extracted and compiled in it's own versioned directory, with each new version the cache is invalidated by the different path.
https://bugs.gentoo.org/346063