alt Hacker NewsI am currently working on deep context query which uses dynamically generated regex to pull only the relevant context blocks. By using lightweight RegEx pattern matching to detect semantic intent and filter structured context sections accordingly, you avoid the attention degradation that comes from stuffing semantically redundant information into the window
https://jdsemrau.substack.com/p/tokenmaxxing-and-optimizing-...
The more real world use cases we see, the more we see the use of a well thought out regex as a bridge from probabilistic to deterministic.