alt Hacker NewsRecently I started this open source project at my AI company, where I'm trying to make LLMs working
Now Reached 16B models running on iPad Air 1st gen and xiaomi tv box, both have less than 1GB of usable memory, and reached some decent speeds given the hardware.
I'm open sourcing the effort done, kernels developed and results for everyone to re-produce and push more, also the modified models are on hugging face : https://huggingface.co/hyperionaidev
I want a more challenging device, what do you think?
Replies
perhaps the pi 1st/2nd gen?
I'd thought of the ESP32 devices but their RAM is too small
A PlayStation 2 dev kit (with 128 MiB of RAM instead of the standard 32 MiB).
Between the VUs, the R5900's SIMD (MMI), the GS and the I/O buses (FireWire, Ethernet, IDE, Memory Cards...) to stream model weights, the smallest Bonsai models (or aggressively quantized Qwen3.5-0.8B) and some really cursed programming might just eke out something the PlayStation 2 has no business running.
> I want a more challenging device, what do you think?
One of those vapes with a screen on it.
> a more challenging device
A Playdate