alt Hacker NewsSome of the smartest people on the planet all in the same room, data at their fingertips… they randomly add it to the training set?
Labs at least must study prompts in an airgapped fashion. From there, consider how they could generate synthetic data to train another model. After, require trusted staff to do multiple levels of independent granular reviews of all fruits of the highest-value stolen inputs. (Or for model training data only, data never has to leave the airgap.)
Definitely risky, anyway. Surely some AI user has sent data, in confidential mode, with a unique shape they expect to be able to recognize if a later model recreated a facsimile even with heavy substitutions… but labs could bring risk of getting caught (over next few years) down quite low with extraordinarily ultraparanoid strategy. (But hopefully everybody is just behaving!)
That is an interesting thought.
They could run some sort of analysis to find high value input, such as proprietary technology, algorithms, or strategy.
Then they could group them together for one specific topic, and produce a report that analyzes if the information is plausible.
If so, they can have it send to staff for review, who could then create a test set that rewards the model for going into the direction of the proprietary solutions known to work.
I'm no expert, but at least something like that sounds plausible to me. I still very much doubt they are doing this.