Makes me wonder how much real world industrial espionage happens. Most companies are not sitting on "pre-post-Singularity-AI-god-intelligence-technology" valuations so the actual secret sauce between competitors strikes me as pedestrian and not worth the hassle.

This repo already has ~6k downloads, so surely those who really care (OpenAI, DeepSeek, etc) have a copy without doing the leg work themselves (assuming it is real). Although, I thought at this point, the pre-training between the companies would be mostly identical, so all of the real work comes afterwards.