> Maybe the answer is to partner LLMs with Common Lisp

Autolith (https://autolith.rocks/) and some other CL-based harnesses allow the LLM to modify their own harness within the session.