If I had the capital I’d make an household inference appliance.
No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility.
Even the appliance faceplate would be a display showing stats like an old HiFi stereo.
Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU + memory
Sounds like reinventing the home server.
Isn't that what what George Hotz is doing over at tiny? https://tinycorp.myshopify.com/
build a Xeon / epyc 4u server. 12 channel ram.
[flagged]
You're describing the mac mini/studio with some facelift.