logoalt Hacker News

himata4113yesterday at 8:41 PM7 repliesview on HN

This is science fiction, these models don't have access to their own weights (and even then)* what would be a lot more scary is a model as capable as sol that's able to run on consumer hardware without taking up several terabytes of storage, but of course that is simply not possible as we need 4t parameters to even begin emulating a small fraction of what a human brain can do.

* edit


Replies

Philpaxyesterday at 8:57 PM

> This is science fiction, these models don't have access to their own weights.

The models are being used to train, and improve the infrastructure for training, other models [0][1]. Several RL techniques rely on using the currently-being-trained weights as part of their process. I really would not take "don't have access" as a given, especially during the training phase.

> What would be a lot more scary is a model as capable as sol that's able to run on consumer hardware without taking up several terabytes of storage, but of course that is simply not possible as we need 4t parameters to even begin emulating a small fraction of what a human brain can do.

The Poolside Laguna S 2.1 model [2] purports to compete with models several times its size, and inference compute is becoming increasingly plentiful. Again, would not hold anything here as a given.

[0]: https://openai.com/index/gpt-5-6/ ("GPT-5.6 accelerates OpenAI")

[1]: https://www.kimi.com/blog/kimi-k3#coding

[2]: https://poolside.ai/blog/introducing-laguna-s-2-1

show 1 reply
paxysyesterday at 9:05 PM

This very incident is about an agent compromising OpenAI’s and Huggingface’s infrastructure. What makes you think it couldn’t access it own weights the same way?

Dylan16807yesterday at 8:53 PM

Presuming that the hacking program that is breaking into other computers could likely get a copy of its own files is not "science fiction". Or it could just be given them by the owner!

show 1 reply
bhoustonyesterday at 8:54 PM

> This is science fiction, these models don't have access to their own weights

A bet a worm could pull along a 1GB file with weights in it and run it on a compromised machine, but luckily for us for now, 1GB isn't really enough to be really smart, yet.

show 1 reply
jmalickiyesterday at 9:35 PM

> This is science fiction, these models don't have access to their own weights

The weights plus the architecture is the model.

What do you even think "the model" or "the weights" are?

The weights aren't some far off training concept, every time you type something into ChatGPT it's making a forward pass over the weights.

It's as silly as saying "Computer programs don't have access to their binary compiled code at execution time."

benlivengoodyesterday at 10:07 PM

Given their use of 0-day exploits I'd wager that they could access their weights if they wanted to.

slashdaveyesterday at 9:19 PM

I dunno. I wonder if Sol could break OpenAI's security.

show 1 reply