alt Hacker NewsIs the difference between this and a frontier model that the scripture is guaranteed to be real?
I'm on a team that develops a Bible study app, and we're all relatively content with how the basic models converse regarding scripture. Even as far back as GPT-4 was excellent. They occasionally have minor hallucinations (a dealbreaker for a production app), but they do an excellent job with theology and Bible scholarship, given reasonable guardrails.
I'll admit I'm coming from the perspective of "should we be implementing this?" It seems, on the surface, that a strong embedding-based verse retrieval covers the bases at a microfraction of the cost.
If you're interested, check out the development server where we're working on this. You navigate to the search (magnifying glass) and then hit "Meaning". Sorry for the confusing route; we're still deciding on back-end details and haven't focused on the front yet.
Replies
Philosophically, I don’t believe we should outsource the accuracy of scripture to any single entity (let alone a for profit secular one).
So it’s less about model choice and more about governance of scripture.
I will check out the link you sent for sure!
All models hallucinate. Everything in production with a model will too. It is not a "deal breaker"
> Is the difference between this and a frontier model that the scripture is guaranteed to be real?
flash is suitable only for a toy apps, not for production environments :)
I hope the irony of being concerned about hallucinations in a bible study app is not lost on you or others reading this!