I don't use any open-weights models for coding, but I use them heavily for document categorization and extraction. At millions-of-documents scale even the smallest models from OpenAI or Google cost more than running a small model on my own hardware, and for a lot of tasks I don't need the extra intelligence of proprietary models.
I don't use any open-weights models for coding, but I use them heavily for document categorization and extraction. At millions-of-documents scale even the smallest models from OpenAI or Google cost more than running a small model on my own hardware, and for a lot of tasks I don't need the extra intelligence of proprietary models.