I saw this post a while ago: https://benkaiser.dev/can-llms-accurately-recall-the-bible/
While LLMs are in generally fairly good at recalling bible verses, they can't do it perfectly. If the Bible truly is the infallible word of God that we believe, then shouldn't we use more caution than just "welp, sometimes it makes mistakes"?
You could counter this by saying a person can't remember Bible verses, and this is true, but a person usually recognizes when they can't remember something instead of making something up. If you asked me to recall any random Bible verses, chances are I wouldn't be able to do so. However, unlike an LLM, I would admit I don't know for sure and I would pull out a Bible or look online for an authoritative source rather than adlibbing something on the spot.
I’ve found verse recall to be a problem, but this can usually by mitigated by adding the verse to the prompt or pushing the LLM to search the web.
The main use case for me is interpretation, which LLMs are excellent at.