Your comment reminds me of this classic post: https://www.reddit.com/r/BestofRedditorUpdates/s/uiBsQd8r7f

In short, you can try to charge people (or bots) per page but it's not like you'll ever see that money, as it breaks a fundamental paradigm of the internet.