logoalt Hacker News

Loquebantur • today at 4:29 PM • 7 replies • view on HN

Be cautious what you wish for. Tools don't tell you what to do with them.

Open source LLMs "democratize" access to the "intelligence booster" that is AI. But while that has several benefits, it also has several downsides.

Humanity has the serious problem of being underdeveloped in the "spiritual" department. Ethics is often considered some sort of lifestyle choice, but it's actually the difference between order and chaos in a society.

Everybody being able to do anything means somebody will be able to do something you don't like. At an arbitrary scale.


Replies

adrianN • today at 5:07 PM

Of course openness is only worse than leaving everything under the control of a select cabal of you believe that cabal to be more ethical than the rest of us.

➕ show 2 replies
Zigurd • today at 4:59 PM

The main thing that bugs me about the risks discussion around AI is the lack of specificity. Commenters here have a good grasp of the risks around finding vulnerabilities faster than they can be patched. That's good and it matches the applicability of LLMs to coding.

But the applicability and the ROI of LLMs for other use cases than coding is a lot squishier. Also correspondingly the risks are unspecific.

As for what to do, ethical disclosure of vulnerabilities provided a good framework for disclosing software vulnerabilities discovered with the assistance of LLMs. What is going to be novel and calls for our spiritual development in other domains?

➕ show 2 replies
computerdork • today at 4:38 PM

Ah, didn't think of this. Some rogue militia group might try to use this LLM (or create their own LLM based on this work) to help them create biological weapons or to do a mass hacking the infrastructure of targeted country.

Wonder what safeguards Kolibri uses to prevent this? Or if they even can

➕ show 2 replies
ofjcihen • today at 5:20 PM

Oh definitely, and I’m in the cybersecurity space so I’m already on the “worst case scenario committee” hah.

But the alternative just seems… so much worse to me?

A select few groups gating access to the ability to do everything seems like neo-fuedalism in the making.

And to be fair even the gating that we do have (daybreak, CVP, etc.) is already being circumvented via keys being stolen and sold on the dark web.

➕ show 1 reply
throwaway27448 • today at 6:34 PM

I think the unethical things are happening already with boutique firms. I admit I don't get the concern.

OtomotO • today at 6:28 PM

> Humanity has the serious problem of being underdeveloped in the "spiritual" department.

As is shown to us by filthy rich people every day.

Or did you mean the burglar in the fawellas?

98753579909754 • today at 5:28 PM

[dead]