logoalt Hacker News

tonymetyesterday at 9:21 PM1 replyview on HN

I’m an outsider with experience building crawlers. You can get pretty far with residential proxies and browser fingerprint optimization. Most of the b-tier publishers use RBC and heuristics that can be “worked around” with moderate effort.


Replies

quietsegfaultyesterday at 9:40 PM

.. but what about subscription only, paywalled sources?

show 1 reply