logoalt Hacker News

adamtaylor_13today at 4:45 PM5 repliesview on HN

What sort of tasks are you using self-hosting for? Just curious as I've been watching the scene but not experimenting with self-hosting.


Replies

vunderbatoday at 4:57 PM

Not OP but one example is that recent VL models are more than sufficient for analyzing your local photo albums/images for creating metadata / descriptions / captions to help better organize your library.

show 1 reply
ktimespitoday at 5:17 PM

For me, receipt scanning and tagging documents and parts of speech in my personal notes. It's a lot of manual labour and I'd like to automate it if possible.

show 1 reply
mentalgeartoday at 5:32 PM

Adding to the Q: Any good small open-source model with a high correctness of reading/extracting Tables and/of PDFs with more uncommon layouts.

BoredPositrontoday at 4:59 PM

I use local models for auto complete in simple coding tasks, cli auto complete, formatter, grammarly replacement, translation (it/de/fr -> en), ocr, simple web research, dataset tagging, file sorting, email sorting, validating configs or creating boilerplates of well known tools and much more basically anything that I would have used the old mini models of OpenAI for.

irishcoffeetoday at 4:47 PM

I would personally be much more interested in using LLMs if I didn’t need to depend on an internet connection and spending money on tokens.