“We toss the coin, but it is the Lord who controls its decision.” - Proverbs 16:33 (TLB)

I don't think Bible verses are related.

There are multiple ways to ground Bayesian statistics without resorting to grounding in coin flips. The simplest one isn't that robust, there's a mathematical one but it's abstract and uses calculus, there's a quantum one but I'm not even going there, and there's a highly robust one that's too complex for me to understand.