Bot Access Control
Content Signals
Robots.txt answers "may you crawl". Content Signals answers the question it was never designed for: "may you use this for training, for live answers, for indexing".
Why it matters
Three lines let you say yes to being quoted in an answer and no to being trained on, in a form every crawler can read.
Pass criteria
robots.txt declares Content-Signal preferences covering ai-train, search and ai-input.
What the scanner records
Every request the check makes is recorded (URL, method, response status, relevant headers and a body preview) and shown under the check in your results.
Every request the check makes is recorded (URL, method, response status, relevant headers and a body preview) and shown under the check in your results.
How to implement it
Declare AI content usage preferences with Content Signals in robots.txt
robots.txt declares Content-Signal preferences covering ai-train, search and ai-input.
The step-by-step implementation prompt is part of the Pro plan.
See plansScan your site
See whether this check passes on your domain, along with the other 21.