> Can they still train the models over encrypted data?

Yes but then the model becomes encrypted.

IMO ML training is not a realistic application for FHE, but things like federated training would be the way to do that privately enough.