alt Hacker NewsI’m building an open-source project (with a hosted option) that lets web and mobile devs add LLM-powered features with zero backend code. Current platforms like Vercel still require at least a backend serverless function even for basic LLM integrations. This handles key management, access control, usage tracking, rate limiting, message conversation state, etc so devs can focus on frontend.
Where does stuff like the prompts go? If you put them in the frontend then you have a bit of a security, monitoring/etc concern. If you don't put them in the frontend... then you have a backend. (But maybe a simpler backend for devs to work with.)