I don't think Google are advocating for removing the deterministic controls, are they?

Sounds like adding the LLM in would be on top of the existing deterministic controls.

Existing controls handle the "Should you be able to access this resource right now?" the LLM handles "Is this user behaving as we expect them to while accessing this resource?"