Thomas is a born and bred loser, but otherwise they're afraid of being assassinated. Judges are under massive, massive amounts of threat whenever they think to hold Trump to literally any scrutiny whatsoever.
Not a conspiracy theory, this is an open discussion topic among federal judges within their own conferences.
Ah yes, rule of law is when judges get their decisions overruled by invisible terrorists.