If God doesn't exist, then God isn't whispering in his ear like an astrologist would.
If God does exist, then what's the problem exactly?
That God isn't accountable and wasn't elected.
That God isn't accountable and wasn't elected.