logoalt Hacker News

gunalxyesterday at 6:31 PM0 repliesview on HN

Running q3 xss with full and quantizised context as options on a 16gb gpu and still has pretty decent quality and fitting fine with up to 64k context.