> Plus there's zero direct evidence for their colours

This is no longer true! Starting with Sinosauropteryx in 2010, paleontologists have identified what they believe to be fossilized melanin-containing organelles. These organelles, called melanosomes, have different shapes depending on which color they produce, and those shapes are preserved well enough to be visible under an electron microscope.