we've been running something similar in prod. latency is the real bottleneck not accuracy