On-chip decoupling capacitors do get used [1]. The main problem is that they take up a lot of valuable die space for not much capacitance.

[1] https://doi.org/10.1109/SBCCI.2003.1232837