logoalt Hacker News

tcdent • 10/11/2024 • 0 replies • view on HN

> from llama_models.llama3.reference_impl.model import Transformer

This just imports the Llama reference implementation and patches the device FYI.

There are more robust implementations out there.