logoalt Hacker News

thebeasyesterday at 8:18 PM1 replyview on HN

That's why give the chance to the model to call expand() in case if it needs more context. We know it's counterintuitive, so we will add the benchmarks to the repo soon.

Given our observations, the performance depends on the task and the model itself, most visible on long-running tasks


Replies

fcarraldoyesterday at 8:33 PM

How does the model know it needs more context?

show 2 replies