cognitiveSEO Bot
SEO analytics and digital marketing crawler
About this crawler
cognitiveSEO Bot is a web crawler identified by the regular-expression pattern cognitiveSEO Bot in the User-Agent request header. It is categorised as seo. Use the regex above to detect, log, allow, or block cognitiveSEO Bot traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
0.056%
Technical details
- Name
- cognitiveSEO Bot
- Pattern
cognitiveSEO Bot- Tags
- seo
- Reference
- https://cognitiveseo.com/bot
- Added
- 2026/04/17
- rDNS suffixes
.cognitiveseo.com- Instances
- 1 known sample(s)
rDNS verification (FCrDNS)
Verify a request is genuinely cognitiveSEO Bot with forward-confirmed reverse DNS: the client IP's PTR record must end in one of the suffixes below and a forward A/AAAA lookup of that hostname must return the same IP. UA strings alone are spoofable; FCrDNS is not.
.cognitiveseo.com
Sample User-Agent strings
cognitiveSEO Bot
Block this crawler
robots.txt — disallow cognitiveSEO Bot:
User-agent: cognitiveSEO Bot
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} cognitiveSEO Bot [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "cognitiveSEO Bot") {
return 403;
}
← back to all crawlers