alt Hacker NewsYou're right about the original GRPO proposal, but there are simplified variants that do just use best of K sampling.
GRPO (or GRPO like approaches) for diffusion/flow matching similarly can be likelihood free.
You're right about the original GRPO proposal, but there are simplified variants that do just use best of K sampling.
GRPO (or GRPO like approaches) for diffusion/flow matching similarly can be likelihood free.
Without anchoring on the group average it's hardly Group-Relative and without likelihood there's no Policy; that doesn't leave much of the original GRPO unchanged...
Do you have a particular paper in mind that does likelihood-free best-of-K but just calls it GRPO?