Puppeteer

browser-automation Puppeteer

Puppeteer browser automation web crawler

About this crawler

Puppeteer is a web crawler identified by the regular-expression pattern Puppeteer in the User-Agent request header. It is categorised as browser-automation. Use the regex above to detect, log, allow, or block Puppeteer traffic in your web server, CDN edge rules, or robots.txt.

Block-rate · top 25k sites

No block-rate data for this crawler.

Technical details

Name
Puppeteer
Pattern
Puppeteer
Tags
browser-automation
Reference
https://pptr.dev
Added
2026/04/07
rDNS suffixes
.pptr.dev, .puppeteer.dev
Instances
1 known sample(s)

rDNS verification (FCrDNS)

Verify a request is genuinely Puppeteer with forward-confirmed reverse DNS: the client IP's PTR record must end in one of the suffixes below and a forward A/AAAA lookup of that hostname must return the same IP. UA strings alone are spoofable; FCrDNS is not.

Sample User-Agent strings

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/120.0.0.0 Safari/537.36 Puppeteer

Block this crawler

robots.txt — disallow Puppeteer:

User-agent: Puppeteer Disallow: /

Apache .htaccess — return 403:

RewriteEngine On RewriteCond %{HTTP_USER_AGENT} Puppeteer [NC] RewriteRule .* - [F,L]

Nginx — return 403 inside a server block:

if ($http_user_agent ~* "Puppeteer") { return 403; }
← back to all crawlers