That sounds a bit like one of Saturn's (1985-2010) original ideas from the 80s. The plastic paneling was easy to take off so that people could DIY change the colors or add their own panels (and Saturn engineers could quickly revise styles). I am not sure very many people ever did, however. Or even if the cars were all that customizable in the end.
Notably truck people love customizing their trucks. Less so for economy sedan people.