toolgrep

toolgrep / Security

CrawlCheck

One signed answer about any domain before an AI agent reads, cites, connects to or transacts with it.

Visit crawlcheck.io →DocsPricing

CrawlCheck is a verification API for the agentic web. GET /api/v1/resolve returns an Ed25519-signed JSON answer per domain covering what the site permits, what it actually serves to named AI crawler identities, what it declares in machine files (robots.txt, llms.txt, agents.md, sitemaps, MCP/API surfaces), who has proven ownership, whether it imitates a known brand, and a decision (allow, warn, require_confirmation, block or unsupported) for read, cite, connect and transact actions. POST /api/v1/preflight returns a signed decision receipt for one action. Answers verify offline with a dependency-free script (crawlcheck-verify.mjs) against published keys and an append-only transparency log, and each carries a permanent rel="cite-as" URL. Also available as an MCP server at /mcp, over DNS TXT records, and via typed SDKs on npm (@crawlcheck/sdk) and PyPI (crawlcheck). Site owners get a free A-F scan with findings decided by 91 published rules.

Category
Security
Pricing
freemium · from $0
Free tier
yes
API
yes
MCP server
yes
SDK
yes
Open source
no

#ai-agents#api#verification#crawler-detection#mcp#signed-answers#transparency-log

Listed 2026-10-29 · last verified 2026-10-29 · extracted by @cf/zai-org/glm-5.3-flash · confidence 0.95

API
curl https://toolgrep.com/api/products/crawlcheck