alt Hacker NewsI like this comment because its argument only makes sense if you assume that the entire world's output of books and art did not require a huge amount of resources and expertise to make, nor did it add any value.
It's the most CS-major take ever!
Replies
there is a major god complex here.
MBAs and non technical managers = inept Catbert-type charlatans.
Software engineers, devs, etc = geniuses capable of mastering any domain, innate ability to be right on any topic.
I don't think that's what it's saying at all. It's saying that there's a level of creativity in model creation that isn't present in distillation.
No? They outright say the opposite!
Like look, I'm not a native speaker, sure. But I think when someone says "value add", that means there was value there (which you claim they're rhetorically erasing), and then that was added to. Under no interpretation of this phrase do I get an erasure of prior value.
So certainly, as long as words mean anything, no, they absolutely did not say or suggest what you claim they did, and what you extract a thus unreasonable amount of obnoxious schadenfreude from, while throwing in a cheap insult for funsies at the end.
It's the second time I feel compelled to reach for this just today: https://i.kym-cdn.com/photos/images/original/002/659/979/108...
This is a misrepresentation though.
The LLM output, is not the same as the input - there is value add.
Of course works used as raw inputs to LLMs required work and are reasonably subject to IP concerns - but they are different.
It's possible that the LLM makers 'owe' the content creators that created the content they used to make their products - it's an interesting but separate question.
We could very well end up where content IP is protected, LLM output is not and visa versa with reasonable legal founding, doubtful but plausible.
If turning other peoples copyrighted work into a model is transformative enough to be protected then so is distilling that model into a different, better, model.