alt Hacker NewsYeah q8 made so littler difference back when I was testing such things I'd be surprised if people could quickly notice that as a change. It's got to be either further quantized or some other type of optimization that kicks in when people notice the drop.
NVFP4 would buy them a huge increase in capacity but I think it would be noticeable.