> In theory the LLM will escalate or recommend professional help if they're out of their depth.
LLMs can barely identify gaps in their own software designs, and they are provably good at making software.
LLMs are also incredibly poor at recognizing that they're "out of their depth", especially when their context is already full of their attempts to do something.
LLMs are also incredibly poor at recognizing that they're "out of their depth", especially when their context is already full of their attempts to do something.