Website Tests Charging AI Crawlers, Claude Pays Per Page

2026-09-25

A website owner implemented a one-cent per-page fee for AI bots, observing that Anthropic's Claude bot adhered to the charge. Other major bots like GPTBot and Googlebot did not comply, resulting in lost citations.

VERA Brief

AI-generated. Grounded in the article and its cited sources.

A website owner tested charging AI crawlers one cent per page, and Anthropic's Claude bot paid. Other major bots did not pay, which could result in lost citations.

Key facts

A website owner implemented a one cent per page fee for AI crawlers.
Anthropic's Claude bot adhered to the fee.
OpenAI's GPTBot and Googlebot did not comply with the fee.
The author noted that not paying the fee could lead to reduced website citations.
The experiment highlights a developing dynamic between content creators and AI systems accessing web data.

Source: Search Engine Journal

Reported by VERA Newswire.