alt Hacker NewsMaybe people will start running local models on their phones to avoid this, i've seen a couple of apps for android that do just that.
Replies
EFreethought • yesterday at 7:20 PM
Maybe there will be models-as-a-service, MaaS as well. Pay extra for no ads. Like Proton Mail vs Gmail.
My rtx5090 does not have enough vram to run a large model at usable speeds.
What kind of phone do you have that outperforms my gaming rig?