alt Hacker NewsThat page mentions that the model is natively INT4 for most of the params, and 600GB is in the ballpark of what's available there for download.
That page mentions that the model is natively INT4 for most of the params, and 600GB is in the ballpark of what's available there for download.