logoalt Hacker News

embedding-shapetoday at 7:51 AM2 repliesview on HN

They say that including todays date in the system prompt is what "causes" this vulnerability, but they don't suggest a fix. Having the current date in the system prompt tends to help a lot, and even if you don't have that and make some prompt that says "today" or "now" or whatever, the model will promptly call "date" to figure it out regardless.

So what is the proposed "fix" here if there is any?


Replies

villishtoday at 8:44 AM

The NSA’s fast16 driver silently modified nuclear simulation data on computers in Iran. This type of attack is possible with open weight models. For instance give slightly inaccurate gps coordinates within China if model might be used in a weapon system.

There should be absolutely zero trust in any closed or open weight models.

erutoday at 7:59 AM

Btw, if it's just the date (and nothing else) researchers or anyone interested can explore that by just providing future dates and see if anything changes.

show 2 replies