This will cause an extra round trip to the LLM. Which means more $ spent.
Better a round trip than bad/incorrect results. Also, the cache should kick in so the cost will be minimal.
alt Hacker News
Better a round trip than bad/incorrect results. Also, the cache should kick in so the cost will be minimal.