alt Hacker NewsThe original post explains what they did and why better than this post. This post taught me nothing that wasn’t in the original.
Replies
stymaar • today at 1:21 PM
They did, except they also did write an abstract and a title that will mislead anyone who isn't going to read the full paper in details.
It's fair to say that this is malpractice.
➕ show 1 reply
They make it sound like they improve Qwen by reading raw weights. They don't. In fact the experiments that use raw weights have very little to do with the experiments that work on larger models.