Isn't that the case of over fitting? You have more data, but when you ask something that's not in that data, hallucinations happen