alt Hacker NewsThe number of sides has nothing to do with the data within. It's not random and sometimes it repeats things in an obviously non-chance way.
The number of sides has nothing to do with the data within. It's not random and sometimes it repeats things in an obviously non-chance way.
Of course, it's random and by chance - tokens are literally sampled from a predicted probability distribution. If you mean chance=uniform probability you have to articulate that.
It's trivially true that arbitrarily short reconstructions can be reproduced by virtually any random process and reconstruction length scales with the similarity in output distribution to that of the target. This really shouldn't be controversial.
My point is that matching sequence length and distributional similarity are both quantifiable. Where do you draw the line?