Yeah but it gets absurd if enough time passes.
"Your ancestors wronged my ancestors 1000 years ago, so now modern you owes modern me"
Yes, and repay it by giving back said object. Egypt or those countries didn't ask for rent or back payments so let's stop imagining strawmen.
This is I think a thing that is difficult for Americans to understand, because the only Americans who have a thousand years of family history in the place they currently live are also asking museums for their stuff back.