Vllm-mlx with prefix caching helps with this.