The CompWatch scraper
CompWatch is an independent aggregator that lists UK prize competitions with odds, expected value, and trust ratings. We read public competition pages — we never ask operators to send us data. If your site is behind a firewall (e.g. Cloudflare) and we can't reach it, allow our scraper below and we'll list your competitions on the next crawl.
Our identity
- User-Agent (allow this)
CompWatch/1.0 (+https://compwatch.co.uk)
Allow us through Cloudflare (~2 minutes)
Pro / Business / Enterprise (recommended)
- Dashboard → your domain → Security → WAF → Custom rules → Create rule.
- Name it Allow CompWatch scraper.
- Set the expression (Edit expression → paste):
http.user_agent contains "CompWatch"
- Action: Skip. Tick All managed rules, All Super Bot Fight Mode rules, and All rate limiting rules.
- Deploy. That's it — we'll pick you up on the next crawl.
Free plan
- Free plans can't match by User-Agent in a WAF rule. The simplest fix is to turn off Bot Fight Mode (Security → Bots).
- Or upgrade to Pro to use the rule above. Stuck? Email us and we'll sort out an allowlist.
Remove the rule any time to be de-listed. Questions? Email [email protected].