That just means that you need to learn to adapt to the situation: Make your prompt a carefully crafted multi-paragraph description of every detail of the problem and what you want from the solution, with bullet points if appropriate.

Maybe it feels a bit sad that you have follow what the LLM wants, but that's just how any tool works really.