JobFeed discovery script
JobFeed job listing discovery crawler
About this crawler
JobFeed discovery script is a web crawler identified by the regular-expression pattern JobFeed discovery script in the User-Agent request header. It is categorised as seo. Use the regex above to detect, log, allow, or block JobFeed discovery script traffic in your web server, CDN edge rules, or robots.txt.
Block-rate · top 25k sites
No block-rate data for this crawler.
Technical details
- Name
- JobFeed discovery script
- Pattern
JobFeed discovery script- Tags
- seo
- Reference
- http://www.jobfeed.com
- Added
- 2026/05/09
- Instances
- 1 known sample(s)
Sample User-Agent strings
JobFeed discovery script (http://www.jobfeed.com)
Block this crawler
robots.txt — disallow JobFeed discovery script:
User-agent: JobFeed discovery script
Disallow: /
Apache .htaccess — return 403:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} JobFeed discovery script [NC]
RewriteRule .* - [F,L]
Nginx — return 403 inside a server block:
if ($http_user_agent ~* "JobFeed discovery script") {
return 403;
}
← back to all crawlers