logoalt Hacker News

andrew_zhongtoday at 7:31 AM0 repliesview on HN

I will add a PR to enforce robots.txt before the actual scraping.