logoalt Hacker News

stavrosyesterday at 10:13 PM1 replyview on HN

Sure, but if I ask the LLM a question, I'd like it to respond now, instead of tonight.


Replies

toomuchtodoyesterday at 10:20 PM

Certainly, interactive workloads aren’t realistic for time shifting, but agentic coding likely is. Package everything up and ship it as a job, getting a bundle back asynchronously.

show 1 reply