Legal experts warn Meta's new terms still grant broad scraping permissions

still have the ability to disable the crawler via robots.txt flags

Never rely on robots.txt. Configure it, but do not rely on it. A bot will do what a bot can do. Their bots are trivial to spot so close the connection, bonus if done silently closing the socket and inhibiting first RST from web daemon and second RST from the OS.

just rename the company to Meta Law or Zuckerberg & Associates already

Humanity experts warn oligarchs, "not good"

News at never.

Blocking by UA is pointless now, meta-externalagent rotates and a chunk comes off non-Meta ASNs. We matched on ASN plus TLS JA4 and that actually stuck.