GW
Google Web Preview
Google web preview web crawler bot
About this crawler
Google Web Preview is a web crawler identified by the regular-expression pattern Google Web Preview in the User-Agent request header. It is categorised as social-preview. Use the regex above to detect, log, allow, or block Google Web Preview traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
1.2%
Technical details
- Name
- Google Web Preview
- Pattern
Google Web Preview- Tags
- social-preview
- Added
- 2018/05/31
- Instances
- 2 known sample(s)
Sample User-Agent strings
Mozilla/5.0 (Linux; U; Android 2.3.4; generic) AppleWebKit/537.36 (KHTML, like Gecko; Google Web Preview) Version/4.0 Mobile Safari/537.36
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Web Preview) Chrome/27.0.1453 Safari/537.36
Block this crawler
robots.txt — disallow Google Web Preview:
User-agent: Google Web Preview
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Google Web Preview [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "Google Web Preview") {
return 403;
}
← back to all crawlers