logoalt Hacker News

andreypopp • today at 6:42 AM • 1 reply • view on HN

There's no limitation, just have bash commands `read` or `view_image` which communicate back to agent.


Replies

codybontecou • today at 6:49 AM

But doesn't Armin mention the limitation?

> If a multimodal model needs to read an image, it cannot use cat for that because the harness needs to inject the actual image payload into the protocol of the LLM.

Sorry, I'm just not familiar, but it sounds like there's a protocol the model expects when receiving images that bash does not support?

(This is Bonteq, I was just logged into the wrong account.)

➕ show 1 reply