logoalt Hacker News

andoandoyesterday at 11:24 PM1 replyview on HN

Why isnt LLM training itself open sourced? With all the compute in the world, something like Folding@home here would be killer


Replies

DesaiAshuyesterday at 11:51 PM

data bandwidth limits distributed training under current architectures. really interesting implications if we can make progress on that