logoalt Hacker News

fogx • 11/21/2024 • 0 replies • view on HN

we use it and are fairly happy. but provider latency is insanely high (500ms+) for embedding models. best to host on-cluster. hybrid quality is good but modification options are extremely limited and the score very obscure for anything but ranking within the set.