NetShelter ContentScan
Media network crawler categorizing content for ad targeting
About this crawler
NetShelter ContentScan is a web crawler identified by the regular-expression pattern NetShelter ContentScan in the User-Agent request header. It is categorised as advertising. Use the regex above to detect, log, allow, or block NetShelter ContentScan traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
No block-rate data for this crawler.
Technical details
- Name
- NetShelter ContentScan
- Pattern
NetShelter ContentScan- Tags
- advertising
- Reference
- https://datadome.co/bots/netshelter-contentscan/
- Added
- 2026/04/17
- Instances
- 1 known sample(s)
Sample User-Agent strings
Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (NetShelter ContentScan)
Block this crawler
robots.txt — disallow NetShelter ContentScan:
User-agent: NetShelter ContentScan
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} NetShelter ContentScan [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "NetShelter ContentScan") {
return 403;
}
← back to all crawlers