logoalt Hacker News

danielhanchentoday at 10:03 AM0 repliesview on HN

Unsure but yes most likely they use YaRN, and maybe trained a bit more on long context maybe (or not)