The c10k problem is a different problem. It relates to simultaneous open TCP connections at a server. It would take a very very large number of crawler bots to force open 10k connections, I suspect.
> It would take a very very large number of crawler bots to force open 10k connections, I suspect.
You can do that with any system made in the past 15, maybe 20 years.
From the wikipedia page:
"As of 2025, the problem has long since been solved, with the number of possible connections to a single computer being in the millions."
I know it's a different problem but presumably there's at least some relationship/order of magnitude being expressed here...oh well