alt Hacker NewsThat until it becomes illegal to have or use open source models without approval and licence from government. With more talks about on device scanning, this could be easily plumbed in. If OS detects there is open source model, it could brick your device or alert authorities. Then next step will be limiting what operating system you can install. Likely only those where you cannot remove client side scanning.
Replies
It can't easily be plumbed in, though. I can spin up my own Linux build with none of that plumbing and do what I want with it. I can grab China's best models and use them or distilled versions on my own terms because OSS allows for that. Until hardware comes fully locked down and the models cannot be run on old hardware, both a long ways off, OSS is a way out.
Eh probably easier ways to do this. Just sanction all entities that release open weight models for "illegal distillation". Enough to cross the risk threshold for most businesses in the west, and reduce future monetization opportunities.
Not gonna happen; the incentives for bypassing this are too high.
I wonder how you can reliably detect an open source model though. It can be stored in any binary format, and the weights can be modified slightly so that the float values are completely different while the network works the same. The binary that runs it can be obfuscated as well. Maybe the hardware could detect common LLM inference patterns at runtime? That would probably produce many false positives.