Why do you think it is an expert in generating prompts? It has no additional insight into how it works internally than anyone else
Do you really think a random person off the street knows more about how LLMs work internally than the latest frontier model (that has been trained on that material)?
Do you really think a random person off the street knows more about how LLMs work internally than the latest frontier model (that has been trained on that material)?