"Guessing what a pixel's color might be were one to actually do the work and render it" is not the same as actually rendering it. No, upscaling doesn't count.

Doing it for a whole screenful of pixels, for the majority of frames (with multi-frame generation) is even less of it.