I assume old failures aren't kept in the context window at all, for the simple reason that the context window isn't that big.