That's what's breaking the system and causing freezes. You can tune it a bit to minimize when it happens, but not get rid of the issue entirely.

All I want is the oomkiller to always kill firefox. Somehow that's very difficult to achieve.

... which then kills sshd, locking you out of being able to get in and do any recovery.