I can download a ~20GB file to plug into a C++ program that runs completely on my own computer, which gives it some sort of 'brain' with a simplistic form of knowledge acquisition, to the point where i can talk to it with natural language and ask it to do stuff for me.

Just yesterday i ran Devstral Small 2 under koboldcpp with a MCP server that exposes a few simple set-file-contents, get-file-contents, show-file-tree commands and i asked it "fix the formatting in foo1.h using foo2.h as a reference and add doxygen comments using the documentation from API.md" and it did it, all running on my own old PC with everything fitting in a 4 euro USB stick.

To me this is amazing. Sure, there are a bunch of issues, but it far from anything reated to IoT/Wearables/Crypto/etc (VR despite being a niche has a lot of fans so i'm not sacking it with the rest). I couldn't even see myself caring about any of those, but i could see several ways how i could use AI/LLMs before i was even able to run one (though admittedly, not all things panned out as i expected :-P).