alt Hacker News> Wouldn't this also mean that there's an inherent limit to that sort of model?
If all need just 16 dimensions if we ever make one that needs 17 we know we are making progress instead of running in circles.
> Wouldn't this also mean that there's an inherent limit to that sort of model?
If all need just 16 dimensions if we ever make one that needs 17 we know we are making progress instead of running in circles.
you can always make a new vector that's orthogonal to all the ones currently used and see if the inclusion improves performance on your tasks