Contacts Crawler
ScrapingHub contacts data crawler
About this crawler
Contacts Crawler is a web crawler identified by the regular-expression pattern Contacts Crawler in the User-Agent request header. It is categorised as seo. Use the regex above to detect, log, allow, or block Contacts Crawler traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
No block-rate data for this crawler.
Technical details
- Name
- Contacts Crawler
- Pattern
Contacts Crawler- Tags
- seo
- Reference
- http://www.scrapinghub.com
- Added
- 2026/05/09
- Instances
- 1 known sample(s)
Sample User-Agent strings
Contacts Crawler (+http://www.scrapinghub.com)
Block this crawler
robots.txt — disallow Contacts Crawler:
User-agent: Contacts Crawler
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Contacts Crawler [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Contacts Crawler") {
return 403;
}
← back to all crawlers