alt Hacker NewsIt’s also a “you can’t scrape us but we can scrape you” mentality these companies are getting into.
It really sucks for small businesses. Their websites get absolutely hammered and they can’t afford or don’t know how to stop it. Cloudflare ends up winning as they’re the easiest solution.
Replies
> Cloudflare ends up winning as they’re the easiest solution.
What prevents other hosting sites from providing similar tooling?
Small businesses should be the people happiest about AI scraping. It's a new venue opening up for them to sell their products and services. And it's easy and free to use Cloudflare so that you don't have to worry about excess traffic, if you don't want to use a different solution.
Does it suck if you offer a product and someone’s looking for it and the agent can’t look on Amazon but they can look on your small side maybe that’s good
what solution is there other than cloudflare that a small business (with decent dev knowledge and claude/codex) could use?
In the spirit of open source thought about it and created sibuna (https://github.com/insanai/sibuna)
It works similar to cloudflare WAF but is an open source software. It can be on your own infrastructures even if its a $5 VPS.
The idea is same let the bot or AI agent do more work than it takes to serve that request. Also it needs to follow rules, similar to cloudflare enterprise web application firewalls. It was OWASP CRS and J4A TLS support.