Spinn3r
Defunct commercial crawler for blogs and news
About this crawler
Spinn3r is a web crawler identified by the regular-expression pattern Spinn3r in the User-Agent request header. It is categorised as feed-reader. Use the regex above to detect, log, allow, or block Spinn3r traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
0.46%
Technical details
- Name
- Spinn3r
- Pattern
Spinn3r- Tags
- feed-reader
- Reference
- http://spinn3r.com/robot
- Added
- 2026/05/02
- rDNS suffixes
.spinn3r.com- Instances
- 2 known sample(s)
rDNS verification (FCrDNS)
Verify a request is genuinely Spinn3r with forward-confirmed reverse DNS: the client IP's PTR record must end in one of the suffixes below and a forward A/AAAA lookup of that hostname must return the same IP. UA strings alone are spoofable; FCrDNS is not.
.spinn3r.com
Sample User-Agent strings
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Tailrank (Spinn3r 2.1); http://spinn3r.com/robot) Gecko/20021130
Block this crawler
robots.txt — disallow Spinn3r:
User-agent: Spinn3r
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Spinn3r [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Spinn3r") {
return 403;
}
← back to all crawlers