Login to your Cloudflare account and select the website in question. From the left hand menu, open the Security dropdown and then select WAF (Web Application Firewall).
To create a new rule, press the button for Create rule on the 'Custom rules' tab:
Give your firewall rule a name β you now have 2 options for unblocking Sitebulb.
If you have a static IP address, we advise you to select IP Source Address and enter in your own external IP.
If you want to crawl with Sitebulb from different locations/IP addresses or might not have a static IP address you can add Sitebulb to your allowed User Agent strings.
The IP address of your Sitebulb Cloud server is constant over time, so whitelisting it will be a good long-term solution, that you can share with your clients.
You can find your IP address within Sitebulb, by following the steps outlined in this document.
Then select Skip from the 'Choose action' dropdown, which will open up a new set of options.
β
If you are unsure what any of these mean, refer to Cloudflare's documentation, typically the option 'All rate limiting rules' is adequate for most users.
β
Ensure you hit Deploy when you have finished.