> Local inference for chats sucks.
/r/SillyTavernAI would disagree with you.
Many people who use ST have a "serious" nvidia card.
We are talking about NPUs here.
alt Hacker News
Many people who use ST have a "serious" nvidia card.
We are talking about NPUs here.