FAQ

This issue is caused by a bad selector. Whenever you choose content for a field, a text field with red text appears. This is the selector that will be used to import your data. If that selector isn’t the same on all pages, than the scraper cannot find the content. If you understand CSS selectors feel free to edit this selector data yourself. If not, we suggest trying to select content differently. For example, instead of choosing the blue box that surrounds three paragraphs and an image, try selecting each paragraph and the image separately and you may get different results.

Depending the URL you are selecting from, there may only be a limited number of links to choose from. If the target page only has four links then the scraper can only crawl those four links for any URLs that match your criteria.

The Scraper also abides by any nofollow rules and the robots.txt on the target URL. This can prevent the scraper from indexing certain pages.

Unfortunately WordPress is notorious for conflicts between themes and plugins. It is unavoidable as you have no control over what other plugins and themes do. While we do take steps to avoid conflicts as best we can, we have no control over other plugins or themes.

As conflicts are found we will update this list. If you discover a conflict with a another plugin, please notify us.

Here is a list of known plugin conflicts:

None at the moment

Yes. If you abuse the sites resources by coping to much content many of the bigger sites will temporally block your IP. (usually for a day)

WP Scraper will work on most websites but some websites have added security that prevents copying content.

Generating URL’s with the PHP Crawler:
Depending on the PHP version on source site and installation site results will vary.

Generating URL’s with the visual selector:
Works best on site maps and blogs, Select one link on site map or blog archive page and it will automatically gather all links.

If the PHP crawler and the visual selector does not meet your needs, we recommend trying Spider: ( free version )
https://www.screamingfrog.co.uk/seo-spider/