alt
Hacker News
andrew_zhong
•
today at 7:31 AM
•
0 replies
•
view on HN
I will add a PR to enforce robots.txt before the actual scraping.