Remember, "no answer" is still a data point.

https://en.wikipedia.org/wiki/Adverse_inference