logoalt Hacker News

ankit219today at 1:45 AM0 repliesview on HN

Why would scheduling be a thing in this case? I might be missing something here.

With continuous batching, you don't wait for entire previous batch to finish. The request goes in as one finishes. Hence the wait time is negligible.