I think it's an interesting idea, but should be set as an option and default to off, for the reason you describe.

If the user sets a sensible 16 color palette though, many old utils could look great out of the box. I'm enticed by the idea.