logoalt Hacker News

embedding-shapeyesterday at 7:28 PM1 replyview on HN

No, basically, the requests are processed in batches, together, and the order they're listed in matters for the results, as the grid (tiles) that the GPU is ultimately processing, are different depending on what order they entered at.

So if you want batching + determinism, you need the same batch with the same order which obviously don't work when there are N+1 clients instead of just one.


Replies

chrisjjyesterday at 7:36 PM

Sure, but how can that lead to increased demand resulting in decreased intelligence? That is the effect we are discussing.

show 1 reply