logoalt Hacker News

Rendelloyesterday at 10:27 PM1 replyview on HN

The hard-coded dictionary wouldn't be much stranger than Brotli's:

https://news.ycombinator.com/item?id=27160590


Replies

maxbondtoday at 5:45 AM

You can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them.