logoalt Hacker News

nlyesterday at 4:53 AM1 replyview on HN

I guess the op was implying that is something fixable fairly easily?

(Which is true - it's easy to prompt your LLM with the language grammar, have it generate code and then RL on that)

Easy in the sense of "it is only having enough GPUs to RL a coding capable LLM" anyway.


Replies

measurablefuncyesterday at 5:24 AM

If you can generate code from the grammar then what exactly are you RLing? The point was to generate code in the first place so what does backpropagation get you here?

show 1 reply