To be honest, I just want to make porn. My own porn, the way I want it. That’s what I’m waiting for. Why the heck do I need to scroll through pages of boring, vanilla, pedestrian porn on Pornhub or RedGIfs or XNXX when I can create exactly what I want? That’ll be a huge killer app when I can do it locally and in the privacy of my own home.
In addition to self hosting, anonymous access to hosted inference is another interesting path.
There’s a “A Decentralised LLM Routing Marketplace” being built out on nostr that leverages ecash.
I didn't see any mention of the hardware OP is planning to run this on -- any hints?
People are talking about AI everywhere, but where can we find documentation, examples, and proof of how it works? It all ends with chat. Which chat is better and cheaper? This local story is just using some publicly available model, but downloaded? When is this going to stop?
Curious with the hardware used in this article.
The socialist EU allows only AI that serves the governance purpose. The EU has rightfully acknowledged that freedom of AI is essentially freedom of speech.
Hacking officially stopped being non-political in EU.
https://artificialintelligenceact.eu/
Enjoy understanding this here: https://artificialintelligenceact.eu/article/3/
Measures of Innovations rank at... Article 57! https://artificialintelligenceact.eu/ai-act-explorer/
I bet that soon, anyone involved with sophisticated AI systems will be system-checked and require a license.
God bless you all out there and have phun!
did this by running models in chroot
See
local is so hot right now
Local is important for compliance with GDPR and closed source software
I hate sending my code to openAI or my client's code.
I find local llms to be usable for short snippets but still too slow for a lot of things.
I just spent hours debugging code mistral ai gave me and had multiple errors, rtfm is still most of the times better than relying on an llm
[dead]
[dead]
[dead]
[dead]
Mr Stallman? Richard, is that you?
So there are models to download but:
a) on what data that things was trained ?
b) any reproducible builds projects ? ;)