I built a similar idea as a hobby project to see what was possible with harnesses. My idea was give a model a chat input, but outputs can be data models (sqlite), and panels that are custom react components that can be generated and mounted on the fly by the model.
The basic idea in todo list form was:
"Let's build a todo model to manage my daily tasks, then build a task list panel where i see today's todos."
It got more interesting from there as I kept building ontop of it. For example, I added data hooks (trigger something when data changes, e.g. custom code or even webhooks) and it felt like an AI native Airtable.
Everything persists and becomes the UI of the app itself.
this is very easy (and fun) to do in emacs with gptel as well
you can do a lot of very neat stuff when your llm has full access to a lisp repl that can self modify itself / the ui its running in
The project seems to be a great initiative however does it have checkpoints? I find that feature a must with agentic workflow for very obvious reasons.
In my opinion it can be more usefol if I can add it with an mcp server, so I can use with my agent and test it in real workflows to see if it can add power and some prons to my agent
letting the agent build its own panes is a neat idea. do people keep the layouts it creates?
Sounds cool, can you explain a bit more how it works?
Hi HN, I built Panel because research work means switching all the time between a chat with an agent, the papers I'm reading, the notebook I'm running and the data files I'm looking at.
Panel is a local web app with dockable panes made with dockview. You get chat, files, PDFs, markdown and Jupyter notebooks.
The agent can also create custom panes on request, like a protein structure viewer or an SQLite browser.
There's also an early "Module" system. Modules are like Skills, but with typed inputs, outputs and intermediates, so a long job shows its progress and its results can feed the next step. Right now the working one is a literature review, with an early version for hypothesis generation.
How it's built: a Vue + dockview frontend and a Python (FastAPI) sidecar that drives the agent backends. Everything runs on your machine.
Honest limits for now: - Full support is Claude Code only, so you need it installed and signed in. Codex and other harnesses are not supported yet. - Still very rough around the edges, I've been adding to it as I use it myself. Feedback welcome!
MIT licensed.
[flagged]
Hey OP I made something very similar called slices-ide [0]
It’s a self modifying editor with embedded agents. Honestly that description doesn’t do it justice, it was an experiment in making an architecture to use the strengths of my adhd when coding.
You can chat with agents inside the editor itself and ask them to modify ANYTHING in the IDE itself, including adding custom panels, changing the theme, rewriting logic
Hell, if they wanted to they can brick the entire editor too or remove agents entirely lol. There is a global undo / redo and timeline so as long as the timeline isn’t bricked you can step back to an earlier point in time
The editor has a visualisation panel that shows all data flowing around the ide itself
You might enjoy it, i think it’s cool and it’s very very experimental
[0] - https://github.com/con-dog/slices-demo#slice-ide---an-experi...