Could this be some kind of https://en.wikipedia.org/wiki/Bufferbloat problem?
Sure we are talking about a different level in the networking stack and very different protocols. But with every component you add things get less synchronous. Well, no buffering needs to involved by the middleman, the mechanism for the throttling could also be different. What do I know...