logoalt Hacker News

t_mahmood • today at 2:05 PM • 1 reply • view on HN

Correct me if I wrong, I saw this when llama.cpp or ollama initializes, it is used as token separator of some sort.


Replies

cowlevel • today at 2:09 PM

GPT-2 used <|endoftext|>