You can use an offline model via ollama. I'm sure better tools will emerge for less technically-inclined individuals.
Seems like there might be demand for chat clients with end-to-end encryption.