I agree. Nitpicking:
> (they got nothing to eat)
They can eat fats, that are not chiral.
Perhaps they can eat some carbohidrates, all carbohidrates are chiral, but some bacterias may eat some of the unusual carbohidrates too. But amino acids are beyond any possibility, and fixating nitrogen is hard, so I also think they will starve to death very fast.
It's generally possible to epimerize l-amino acids to d- (or functionalize glycine) but you're competing with nonmirror life at that point. plus bacteria will love love love the d-alanine you make