logoalt Hacker News

mathiaspointlast Sunday at 12:47 PM3 repliesview on HN

I use a 500 million parameter model for editor completions because I want those to nearly instantaneous and the plugin makes 50+ completion requests every session.


Replies

ghxstlast Sunday at 2:51 PM

What editor do you use, and how did you set it up? I've been thinking about trying this with some local models and also with super low-latency ones like Gemini 2.5 Flash Lite. Would love to read more about this.

show 1 reply
badlogiclast Sunday at 3:00 PM

Can you share which model you are using?

myflash13last Sunday at 2:16 PM

Which model and which plugin, please?