logoalt Hacker News

ubermontoday at 4:01 PM6 repliesview on HN

Hi HN, I'm Mohan from Antigma Labs. Ante is a coding agent that ships as one self-contained ~15MB binary: the TUI, an embedded ripgrep, local PDF/OCR, and a natively managed llama.cpp engine are all inside. No runtime dependencies, no node_modules, no account.

- Ante installs a pinned, checksum-verified official llama.cpp build matched to your machine (Metal on Apple silicon; CUDA, Vulkan, or CPU on Linux) and handles upgrades when the pin changes. - It discovers GGUF files already on disk (~/.ante/models, the llama.cpp and Hugging Face caches), attaches to llama servers already running on local ports, and estimates RAM/VRAM from model size and context window before anything loads. - `ante --offline-model /path/to/model.gguf "prompt"` boots the server, runs the session, and shuts it down. `/offline-mode` does the same interactively; `ante serve --offline-model` loads a model once for many clients. - No API key, no account. Once the model is on disk, inference needs no network at all; set ANTE_TELEMETRY=off and no telemetry is exported either.

On capability, we'd rather publish the number than oversell: we benchmark local models with the same harness and auditable runs as frontier ones, and Qwen3.6 27B (a 17 GB download) scores 56.2% on Terminal-Bench 2.1 across 445 trials (live results: https://antigma.ai/eval). That's a real gap from frontier models. The design bet is that you mix: hosted providers and local live in the same catalog, `/providers` switches mid-session, so sensitive repos or high-volume work go local and hard problems go frontier.

Hosted models work with your own keys or subscription. But nothing about trying Ante requires signing up for anything: download the binary, point it at a GGUF.

Offline mode is under active development and has rough edges with the overview at https://ante.run/local/overview. I'll be in the comments.


Replies

felooboolooombatoday at 6:19 PM

Here you say:

  > Ante installs a pinned, checksum-verified official llama.cpp
But in README:

  > Ante ships its own inference engine
May I suggest you use the first phrasing in both places. I took it as Ante devs had written their own engine and I doubt I'm the only one.
show 2 replies
nazgulsenpaitoday at 4:37 PM

Not sure why this was dead but I vouched. It would be nice if telemetry was opt-in, otherwise this looks awesome and can't wait to try it!

show 1 reply
adastra22today at 5:28 PM

Where is the source code?

show 1 reply
wwww23today at 6:09 PM

Many people have slow computers, but for agent it is no problem. Only run LLM slow too.

show 1 reply
niutechtoday at 5:14 PM

Why not make it Actually Portable Executable using Cosmopolitan Libc, like Llamafile, to make it run on Windows/Linux/MacOS? Why don't you support Windows with CUDA?

show 1 reply
majorchordtoday at 4:54 PM

Opt-out telemetry is a hard no for me, sorry.

show 4 replies