alt Hacker NewsTo clarify, this MIT-licensed app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library (https://github.com/Blaizzy/mlx-vlm). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster inference on Apple devices than llama.cpp. Historically, MLX is a smaller community than CUDA, but has some of the fastest updates upon the release of new models, particularly in models with modalities beyond text-in, text-out (vision, STT, TTS, video gen). See also (https://github.com/Blaizzy/mlx-audio-swift). Would be totally unsurprised if those modalities and models get integrated into this UI.
Possibly vibe-coded landing page notwithstanding, the app is mostly written in Swift language. That suggests it will be easy to port this inference stack to iPad and iPhone.
Replies
I would also note that for people who want to download these models, you can find MLX versions of just about everything popular on huggingface these days. For instance go look at the "main" page for Qwen 3.6 35B-A3B and then follow the link to quantizations, and pick one of the more popular/reputable MLX variants.
Would be totally unsurprised if those modalities and models get integrated into this UI.
Support for dedicated audio-only and image-generation-only models is coming soon.
Thanks for that. My first question was “What does this do that Unsloth doesn’t?”
Prince CacheAsNUMA? Nice :)
LM Studio is trash on Windows / Linux... guess that makes sense...
Switching to mlx-vlm is basically harmful since it (like vllm and sglang) have such garbage support for modern samplers. To be clear, I am one of the authors on the min_p paper, and if min_p is the best you have (when llamacpp supports the far superior top-n-sigma), than I have no reason to switch even if you are somehow faster.
(https://arxiv.org/abs/2411.07641)
And if you do care to support modern samplers, you can start with the following:
1. https://arxiv.org/abs/2509.23234
its a wrapper around mlx, so thats gonna be the portability bottleneck
I was so excited when I saw "blaizzy" in the domain, because Prince Canuma's work around MLX has been of such uniquely high quality.