Local AI is the future, and a lot of people want the first mover advantage or to toy around with it. I know a guy with a small rack of Nvidia Spark machines that he uses for that purpose; it's as much as a decent used car.
But is it? If it’s cheap enough latency doesn’t matter. Unlike say cloud gaming, where latency does matter. I’ll take my games local and my text bots cloud
But is it? If it’s cheap enough latency doesn’t matter. Unlike say cloud gaming, where latency does matter. I’ll take my games local and my text bots cloud