Diffbot

AI · TRAINING CRAWL AI SURFACE

Not yet observed on any site Botfall meters. This record exists because the operator documents it — when it shows up in real traffic, its vitals appear here.

Operator	Diffbot
Purpose	AI · training crawl
Identifies as	User-agent substring: `diffbot`

What the operator publishes

Their documentation, not our measurements — re-checked automatically every day.

Operator documentation

https://docs.diffbot.com/docs/en/guides-crawlbot-faq link checked 2026-09-30

Provenance

What establishes this record, and when it was last checked — no speculative entries.

Observed in live storefront telemetry (classifier lineage)checked 2026-07-30

Want these numbers for your own site — which agents read it, what they took, and what it cost? Get started free →