Yes, exactly. Researchers will not like the fact that I refer to the literature as merely a manual, but “RTFM” applies here. Someone has likely already investigated what you’re looking at, or at least found a way to not do it. And sure it’s in the weights, but if you put papers directly in front of the LLM it’s much more impactful.