<div>There are a number of websites that I want to crawl that I get a blank page when I select the Crawling Restrictions and then select the Visual Selector on the section:</div>
<div class=”bws_help_box bws_help_box_right dashicons dashicons-editor-help cr_align_middle”></div>
<b>Seed Page Crawling Query Type:</b>
Is there a way to bypass this or to resolve this?, as about 50% of the websites I want to crawl and select via Visual Selector it gives me back this error.
Here is an example:
https://www.bizjournals.com/orlando/news/residential-real-estate
This particular page gave me back this message instead of a blank page:
<h2>Why am I seeing this page?</h2>
The website you are visiting is protected and accelerated by Incapsula. Your computer may have been infected by malware and therefore flagged by the Incapsula network. Incapsula displays this page for you to verify that an actual human is the source of the traffic to this site, and not malicious software.
<h2>What should I do?</h2>
Just click the <b>I’m not a robot</b> checkbox to pass the security check. Incapsula will remember you and will not show this page again. We recommend you run a virus and malware scan on your computer to remove any infection.
Attachments:
You must be
logged in to view attached files.