The bitter lesson just means “compute scaling beats hand-tuned architectures in the long run”.

As GP said. More RLHF is in fact the bitter lesson.