alt Hacker NewsI'm pretty sure the system instructions are a function of your environment and not the same universally. That said, there should be a finite number of branches so still cacheable.
I'm pretty sure the system instructions are a function of your environment and not the same universally. That said, there should be a finite number of branches so still cacheable.
System specific stuff is probably quite limited, it can be a short dynamic segment at the end of the system prompt, perhaps.