alt Hacker NewsGgml v1.0.0
Comments
Awesome! ggml and llama.cpp are the Linux of the AI world. Driving local inference one bit at a time.
Wishing you unlimited power and may you never see a day of low battery. Respect and Love. Keep it up.
Long time llama.cpp user (and user of other ggml based AI programs) running on my crappy AMD card that only supports vulkan and it's usable thanks to GGML and llama.cpp, great program great project.
I prefer this entry point: https://github.com/ggml-org/ggml
In my opinion, this is a genuine engineering product. LLM.cpp, the savior of our difficult times...
Not just legacy hardware, but also ready for the immediate future, with RISC-V support.
Congrats for 1.0.0.
[flagged]
You are not serious with this landing page?
Please put a little more effort in for FFS, you have seed money?
Let your design show through; your product can still be professional, and you don't have over index on bland to over compensate.
Imagine naming a library after yourself.
> GGML is a C library for machine learning (ML) - the "GG" refers to the initials of its originator (Georgi Gerganov).
https://github.com/rustformers/llm/blob/main/crates/ggml/REA...
[flagged]
What is really impressive about this project and llama.cpp as well is that they keep finding new ways to speed up the code on the same hardware. Every time I upgrade (once a month or so) there is usually a 5 to 10% speed boost.