Why not leverage Apple Foundational models?
Downloads will already be on the machine.
https://developer.apple.com/documentation/foundationmodels
I've tried, they were really bad for this use case.
alt Hacker News
I've tried, they were really bad for this use case.