> First, it assumes that scaling models automatically leads to something dangerous.

The impression I had is with reversed causation: that it can't be all that dangerous if it's smaller than this.

Assuming this alternative interpretation is correct, the idea may still be flawed, for the same reasons you say.