You can also get LLM to optimize rules for a rules engine iteratively against some dataset.
It’s sort of like memoizing or distilling the knowledge. Works really well for certain type of problems.