logoalt Hacker News

I want everything local – Building my offline AI workspace

1099 pointsby mkageniuslast Friday at 6:19 PM281 commentsview on HN

Comments

Woodilast Saturday at 12:00 PM

So there are models to download but:

a) on what data that things was trained ?

b) any reproducible builds projects ? ;)

eyespasmlast Friday at 11:53 PM

To be honest, I just want to make porn. My own porn, the way I want it. That’s what I’m waiting for. Why the heck do I need to scroll through pages of boring, vanilla, pedestrian porn on Pornhub or RedGIfs or XNXX when I can create exactly what I want? That’ll be a huge killer app when I can do it locally and in the privacy of my own home.

unboxingelflast Saturday at 3:36 PM

In addition to self hosting, anonymous access to hosted inference is another interesting path.

There’s a “A Decentralised LLM Routing Marketplace” being built out on nostr that leverages ecash.

https://www.routstr.com/

btbuildemlast Friday at 8:42 PM

I didn't see any mention of the hardware OP is planning to run this on -- any hints?

gen2brainlast Friday at 8:27 PM

People are talking about AI everywhere, but where can we find documentation, examples, and proof of how it works? It all ends with chat. Which chat is better and cheaper? This local story is just using some publicly available model, but downloaded? When is this going to stop?

zakkilast Saturday at 11:39 AM

Curious with the hardware used in this article.

_the_inflatorlast Saturday at 9:18 AM

The socialist EU allows only AI that serves the governance purpose. The EU has rightfully acknowledged that freedom of AI is essentially freedom of speech.

Hacking officially stopped being non-political in EU.

https://artificialintelligenceact.eu/

Enjoy understanding this here: https://artificialintelligenceact.eu/article/3/

Measures of Innovations rank at... Article 57! https://artificialintelligenceact.eu/ai-act-explorer/

I bet that soon, anyone involved with sophisticated AI systems will be system-checked and require a license.

God bless you all out there and have phun!

show 1 reply
nenadglast Friday at 10:57 PM

did this by running models in chroot

josephwegnerlast Friday at 10:59 PM

See

nikolayasdf123last Saturday at 2:01 AM

local is so hot right now

hoppplast Saturday at 11:53 AM

Local is important for compliance with GDPR and closed source software

I hate sending my code to openAI or my client's code.

I find local llms to be usable for short snippets but still too slow for a lot of things.

I just spent hours debugging code mistral ai gave me and had multiple errors, rtfm is still most of the times better than relying on an llm

evrennetworklast Saturday at 12:45 PM

[dead]

jeffWrldlast Saturday at 9:17 AM

[dead]

123sereusernamelast Saturday at 12:25 AM

[dead]

techlatest_netlast Friday at 9:28 PM

[dead]

pymanlast Friday at 7:01 PM

Mr Stallman? Richard, is that you?