logoalt Hacker News

sigbottletoday at 6:06 PM1 replyview on HN

There are so many heavy hitting cracked people like daniel from unsloth and chris lattner coming out of the woodworks for this with their own custom stuff.

How does the ecosystem work? Have things converged and standardized enough where it's "easy" (lol, with tooling) to swap out parts such as weights to fit your needs? Do you need to autogen new custom kernels to fix said things? Super cool stuff.


Replies

bredrentoday at 6:29 PM

Thanks for the notes, for those interested in learning more:

- Lattner tweeted a link to this: https://www.modular.com/blog/day-zero-launch-fastest-perform...

- Unsloth prior post on gemma 3 finetuning: https://unsloth.ai/blog/gemma3