Why not? Von Neumann himself did, in a lighthearted way.

> I told Banach about an expression Johnny had used with me in Princeton before stating some non-Jewish mathematician's result, "Die Goim haben den folgenden satz beweisen" (The goys have proved the following theorem). Banach, who was pure goy, thought it was one of the funniest sayings he had ever heard. He was enchanted by its implication that if the goys could do it, then Johnny and I ought to be able to do it better. Johnny did not invent this joke, but he liked it and we started using it.

https://infoproc.blogspot.com/2021/12/adventures-of-mathemat...

https://en.wikipedia.org/wiki/The_Martians_(scientists)

The Martians (of which von Neumann is usually the most regarded) were mostly Hungarian jews. It's a point on which some people have mused, so it's easy for the thought to point in that direction when von Neumann is brought up.

"if x person is y, and x person has a specific trait, then me being also y means I have the that specific trait"

In other words, if you don't have a dog, you're gay. (If you know the comic)