Related to this post, it looks like Cloudflare is introducing active blocking of website-scraping AI bots, which if it works should be more effective than the robots.txt honor system.
Related to this post, it looks like Cloudflare is introducing active blocking of website-scraping AI bots, which if it works should be more effective than the robots.txt honor system.