alt Hacker News10 GbE sits in a really weird spot for me, maybe I'm just not understanding something though. It's at most 1.25 GB/sec of bandwidth, yet it's relatively quite expensive. It's not sufficient bandwidth for getting good performance out of most SSDs, yet it's really excessive for any hard drives (except for RAID10 setups I guess). For SSDs you want thunderbolt (or 40+ GbE) connection for best latency and performance, and for hard drives 2.5Gbit/sec is more than enough. As I said, I might be misunderstanding something, but 10 GbE sits between the two sensible options for me.
Replies
10gbe is a sweet spot at least for my homelab stuff. It's easy to find old enterprise gear for, cheap, and fast enough for everything I want to do.
I have a zfs x 3 disk hard drive mirror and 10GbE.
For writes yes 10GbE overkill but for for reads it's faster than 2.5GbE would be.
Sure there is 5GbE but most switches that support 5GbE support 10GbE.
I chose 10GbE to fit 20 HDDs in RAID 10.
~ 1 GB/sec seems about right for a long time. I can't imagine the basic files I work with everyday getting much more storage-dense than they are in 2026.
Are you gonna run thunderbolt more than a few meters? If you think 10 is expensive, check prices above 10. You may even need fiber for that.
10 Gb is cheap! Mikrotik has a 4x10Gb + 1x1Gb port switch for $150 USD and an 8x10Gb version for about $275. I have the 8 port version.
SFP+'s and fiber are cheap, like maybe 50 bucks for the SFP+ set and fiber. 10Gb PCIe cards are maybe ~$50 new on Amazon with Intel chips and cheaper on eBay - I bought used 10 Gb Mellanox cards for $25 each - "they just work" under FreeBSD and Linux.
Copper 10 Gb used to consume waaaaay more power (like 5+W per port!) and cost more both in terms of the SFP and cable. In reality fiber is more environmentally friendly as there is no copper, less energy used, and less plastic per meter. So my setup mostly consists of SR and BR optics and DAC's. The "DAC" direct attach cables are handy for switch-switch or short switch<->NIC runs. And I will continue to run fiber for the foreseeable future and actively avoid copper.