logoalt Hacker News

N_Lenslast Tuesday at 4:20 AM0 repliesview on HN

If models naturally occupy shared spectral subspaces, this could dramatically reduce

- Training costs: We might discover these universal subspaces without training thousands of models

- Storage requirements: Models could share common subspace representations