Can somebody comment on the evidence for the following sentence from the article: "After GPT-4, however, continued scaling [number of parameters] began yielding diminishing returns"?
My understanding was that scaling in size slowed for practical/economic reasons, not because of its diminishing intelligence returns.