Website Analyzer
Website analysis tool
About this crawler
Website Analyzer is a web crawler identified by the regular-expression pattern Website Analyzer in the User-Agent request header. It is categorised as seo. Use the regex above to detect, log, allow, or block Website Analyzer traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
0.065%
Technical details
- Name
- Website Analyzer
- Pattern
Website Analyzer- Tags
- seo
- Reference
- http://www.check-domains.com/website-analysis/website-analyzer.php
- Added
- 2026/05/09
- Instances
- 1 known sample(s)
Sample User-Agent strings
Mozilla/5.0 (compatible; Website Analyzer/1.1; +http://www.check-domains.com/website-analysis/website-analyzer.php)
Block this crawler
robots.txt — disallow Website Analyzer:
User-agent: Website Analyzer
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Website Analyzer [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Website Analyzer") {
return 403;
}
← back to all crawlers