and some places charge a higher annual fee for EVs due to roads being largely funded by gas taxes.

Seems totally fair to me so long as the averages largely line up for both vehicle types.