Pay-per-output? AI firms blindsided by beefed up robots.txt instructions.
Pay-per-output? AI firms blindsided by beefed up robots.txt instructions.

arstechnica.com
Pay-per-output? AI firms blindsided by beefed up robots.txt instructions.

Pay-per-output? AI firms blindsided by beefed up robots.txt instructions.
Pay-per-output? AI firms blindsided by beefed up robots.txt instructions.
lol. AI firms stop reading robots.txt
I think the idea is that all parties would find it beneficial so they would be incentivized to read it:
I imagine that when it comes to scraping data, the benefits of having the data far out away the risk of getting sued for scraping it.