You don’t need to enable Gemini or voice assistant on android to use android auto. Some functionality is lost, of course, but you can still navigate and play music.