alt Hacker NewsI don't understand how foveated tracking won't cause a sense that peripheral vision is fuzzy. Or how it will track saccades, and so avoid fringe effects.
But, the "I don't understand" is strong in this. it doesn't mean "it can't work" but I don't understand how it avoids the problems.
Maybe the size of the computed foveal coverage area is made big enough, to cover the movement? But if you move your eyes suddenly, there's got to be some lag while it computes the missing pixels. So you'd see the same as when Netflix ups the coding rate: crude render becomes clearer. Banded would become smooth transitions.
Replies
Sufficient additional coverage + predicting the trajectory of your eyeballs. As far as I know, all of the journalists invited to try it were unable to see the low-res periphery, despite actively trying to break it with fast eye movements.
> won't cause a sense that peripheral vision is fuzzy
it won't because your eyes literally doesn't have enough sensors in those regions to see it.
I guess it would work like the PSVR2 solution, just not implemented at game rendering level but at system streaming level.
> it doesn't mean "it can't work"
I don’t have an answer for you, but take some applause from me for spelling this out :)
It’s very difficult for most people to intuitively understand that what they could not figure out after five minutes of thinking might not necessarily be impossible.
What I don't understand is how this will work with every game automatically? Wouldn't this need support from the graphics pipelines in each games?
Your eye is just another input source, if you don't feel the controller lag from streaming games otherwise, you're probably not going to feel it here either. It's not like an additional round trip or anything, your eye is here and the joystick is here can be sent at the same time, and you get back the rendered frame in return.
As for peripheral vision, any gradation being smooth probably helps, but there might be more tricks to make it look normal. I'm reminded of how jpeg images and some sound codecs only store information that we can actually perceive.
[dead]
Imagine watching Netflix out of the corner of your eye. You wouldn't notice those transitions at all. Your eyes and brain are mind bogglingly good at making stuff up.
Do you know you have a big hole in your vision in each eye where the optic nerve is? It's about half the size of your fist at arm's length, and 35 degrees to the side. Your fovea happens to be roughly the same size. It's the HD part of your retina, and it's where essentially all of your vision happens. It's the only section of the retina that sees color, for instance. The periphery sees motion and that's about it.
Saccades top out at around 700 degrees per second. At 120 frames per second that's only about 6 degrees in either direction. Compared to the FOV, that's tiny. Overfill it!