XML Sitemaps Generator
XML sitemap generation and website structure mapping crawler
About this crawler
XML Sitemaps Generator is a web crawler identified by the regular-expression pattern XML Sitemaps Generator in the User-Agent request header. It is categorised as seo. Use the regex above to detect, log, allow, or block XML Sitemaps Generator traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
0.065%
Technical details
- Name
- XML Sitemaps Generator
- Pattern
XML Sitemaps Generator- Tags
- seo
- Reference
- https://www.xml-sitemaps.com/
- Added
- 2026/04/26
- Instances
- 1 known sample(s)
Sample User-Agent strings
Mozilla/5.0 (compatible; XML Sitemaps Generator; http://www.xml-sitemaps.com) Gecko XML-Sitemaps/1.0
Block this crawler
robots.txt — disallow XML Sitemaps Generator:
User-agent: XML Sitemaps Generator
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} XML Sitemaps Generator [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "XML Sitemaps Generator") {
return 403;
}
← back to all crawlers