logoalt Hacker News

bjackmantoday at 6:28 AM3 repliesview on HN

What, um... Are... Are people using samba to sync model weights between cluster nodes...?


Replies

topspintoday at 10:41 AM

Why not? SMB is no slouch. Microsoft has taken network storage performance very seriously for a long time now. Back in the day, Microsoft and others (NetApp, for instance,) worked hard to extend and optimize SMB and deliver efficient, high throughput file servers. I haven't kept up with the state of the art recently, but I know there have been long stretches where SMB consistently led the field in benchmark testing. It also doesn't hurt that Microsoft has a lot of pull with hardware manufacturers to see their native protocols remain tier 1 concerns at all times.

show 1 reply
whizztertoday at 12:37 PM

Plenty of other workloads that benefit from high performance file access and with networks speeds and disk speeds getting higher whilst single-core perf has more or less plateaued in comparison, it's thus more and more important to support data-paths where the kernel switching won't become a bottleneck.

ycombinatrixtoday at 7:30 AM

Dunno but I have used samba to load model weights from my NAS