Can the 30 second embedding time be done beforehand and sent to the browser?
Inference is nice and quick after that.
yes, you could run a 1 time indexing run on the server side, and just ship the embeddings to frontend
alt Hacker News
yes, you could run a 1 time indexing run on the server side, and just ship the embeddings to frontend