logoalt Hacker News

bingo-bongotoday at 10:49 AM1 replyview on HN

AI companies scrape to:

- have data to train on

- update the data more or less continuously

- answer queries from users on the fly

With a lot of AI companies, that generates a lot of scraping. Also, some of them behave terribly when scraping or is just bad at it.


Replies

adastra22today at 11:03 AM

Why don’t they scrape once though?

show 1 reply