logoalt Hacker News

sudbtoday at 6:53 AM1 replyview on HN

What problem is it that you are confused isn't solved?

I think the codec analogy is neat but isn't the codec here llama.cpp, and the models are content files? Then the equivalent of VLC are things like LMStudio etc. which use llama.cpp to let you run models locally?

I'd guess one reason we haven't solved the "codec" layer is that there doesn't seem to be a standard that open model trainers have converged on yet?


Replies

imtringuedtoday at 8:14 AM

llama.cpp is the ffmpeg/libavcodec equivalent in this story.