w3dt.net httphr
W3DT HTTP response checker
About this crawler
w3dt.net httphr is a web crawler identified by the regular-expression pattern w3dt.net httphr in the User-Agent request header. It is categorised as monitoring. Use the regex above to detect, log, allow, or block w3dt.net httphr traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
No block-rate data for this crawler.
Technical details
- Name
- w3dt.net httphr
- Pattern
w3dt.net httphr- Tags
- monitoring
- Reference
- http://w3dt.net
- Added
- 2026/05/09
- Instances
- 1 known sample(s)
Sample User-Agent strings
w3dt.net httphr/2.0
Block this crawler
robots.txt — disallow w3dt.net httphr:
User-agent: w3dt.net httphr
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} w3dt.net httphr [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "w3dt.net httphr") {
return 403;
}
← back to all crawlers