A New “Robots.txt for Money” Spec Wants AI Giants to Pay Up
Publishers have a new weapon in the fight against AI web scraping. The Really Simple Licensing spec has hit version 1.0, providing a framework to set machine-readable rules—including payment demands—for crawlers. Backed by companies like Cloudflare and Akamai, it aims to turn unwanted bot traffic in