It’s not that it’s not in the context, it’s that it was injected so far back that it is deemed not so important when determining the next token.