logoalt Hacker News

strobe • today at 3:45 PM • 1 reply • view on HN

it interesting because usually on workstation the browser & electron apps it's that holding much of the memory hostage (it's very common to see that browser consuming 20-30gb on 64gb system), so may be if it will be significant compression win on that side it leads to more memory for model but how much performance penalty would be for inference in that case?


Replies

pdlclay • today at 5:03 PM

[flagged]