IAS crawler
Bot of Integral Ad Science, Inc.
About this crawler
IAS crawler is a web crawler identified by the regular-expression pattern IAS crawler in the User-Agent request header. It is categorised as advertising. Use the regex above to detect, log, allow, or block IAS crawler traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
0.13%
Technical details
- Name
- IAS crawler
- Pattern
IAS crawler- Tags
- advertising
- Reference
- https://integralads.com/ias-privacy-data-management/policies/site-indexing-policy/
- Added
- 2018/06/06
- Instances
- 1 known sample(s)
Sample User-Agent strings
IAS crawler (ias_crawler; http://integralads.com/site-indexing-policy/)
Block this crawler
robots.txt — disallow IAS crawler:
User-agent: IAS crawler
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} IAS crawler [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "IAS crawler") {
return 403;
}
← back to all crawlers