I don't know the details but apparently it has something to do with multiprocess contention for the GPU and batch sizing.