logoalt Hacker News

ameliustoday at 12:34 PM2 repliesview on HN

By the way why don't these LLM interfaces come with a pause button?


Replies

ameliustoday at 12:43 PM

And a "prune here" button.

It often happens that the interesting information is in the first paragraph or so, and the remainder is all just the LLM not knowing when to stop. This is super annoying as a conversation then ends up being 90% noise.

show 1 reply
stainablesteeltoday at 12:47 PM

i imagine they're doing superman level distributed compute across multiple clouds somewhere and cared more about delivering the final result of that than having the ability to pause. which is probably possible, but would require way more work than would be worthwhile. they probably thought the ability to stop and resubmit would be an adequate substitute.

show 1 reply