logoalt Hacker News

RetroTechietoday at 6:12 PM0 repliesview on HN

Reads as a well-written mission statement. With nice references that elaborate on some issues.

That said: safety. To prevent harm to who, by AI model doing what?

I can understand that in the context of a cookie-cutter model intended for consumption by a broad audience. With vendor (potentially) on the hook when it's abused for nefarious or illegal uses.

But in the context of AI models reshaped, fine-tuned and adapted according to end-users' wishes, what does "safety" even mean?

Prevent neighbours' kids from seeing images that are only generated & viewed in the privacy of one's home? To prevent AI model from wasting the $ on user's bank account? (people have let AI models do that). Give bad health advice? Who's the judge on "good" and "bad" there?

If the core architecture provides "safety" (however defined), that's policy built-in, right? (opposed to mission statement). If "safety" is just configuration & finetuning, that's in the user's hands, right?