That's exactly how escalation in pagerduty works.