An LLM may be bad at trading stocks, but an LLM may be good at analyzing the wider context, like the news feed, to inform automated trading driven by a more sophisticated model, called by the LLM as a tool.
I don't think that this contraption should necessarily perform tolerably, but the use of an LLM is not necessarily a wrong move.