alt Hacker NewsOne of the biggest differences I noticed off the bat is llms includes prompt caching which I'm not sure I've seen in any other self hosted UI options
One of the biggest differences I noticed off the bat is llms includes prompt caching which I'm not sure I've seen in any other self hosted UI options
I see Lobe and Chatbox both have prompt caching toggles, are you referring to something else?