They don't delegate the policymaking. Tax code is always congressionally approved, and I'm unaware of any even remote argument that changing tax policy is delegated to the executive.

OTOH enforcement of congressional policies is basically always the role of the executive, so the fact that the IRS exists and does things doesn't really impact delegation.