WP Content CrawlerAllows you to automatically publish the content of almost any website to your website, blog or online store on WordPress!

After setting the parameters, the plugin will find the website URL in the background and scan it automatically.

Detailed Toolbar - See what's going on in the background: active web pages, number of messages viewed, number of messages updated, messages viewed and last updated, URLs last added, CRON events started, followed by messages and URLs saved. ..

Demo:https://code canyon.net/search/15983018

Features of WP Content Crawler - Automatically fetch content from almost any website

• Save all article details
• visual inspector
• Crawl (grab, get, save) posts
• Recrawl (update) articles
• delete post
• scheduling control
• save category category
• Save Slugs (permalink)
• บันทึกอนุกรมวิธาน
• Save posts to custom categories
• custom post meta
• ഉള്ളടക്ക ടെംപ്ലേറ്റ്
• Alternative selector
• find and replace anything
• Page number article
• Article list
• remove unnecessary elements
• Automatically insert site category URLs
• Remove link from post
• password protection
• Check everything quickly
• Check all settings of a website at once
• Customizable global settings per site
• Save all images in post content
• save image as gallery
• Any data as shortcode
• Proxy
• Cookies
• Crawl as many posts as possible
• Email notification
• Get data from JSON
• Advanced HTML manipulation
• automatic translation
• Automatic content rotation
• Check Duplicate Posts Duplicate Content
• scheduled post
• Save WooCommerce Products
• Attributes to save alt and other titles...

Changelog WP Content Crawler - Automatically fetch content from almost any site!

= v1.11.0 - 11 March 2021 =
New
Filters. With filters, you can do things conditionally, i.e. you can say “if this happens, then do this”, where the condition part is optional. The filters have 30 Condition Commands and 25 Action Commands. Via the filters’ Action Commands, these are possible:
Make a text uppercase, lowercase, title case, snake case, kebab case, camel case, studly case, slug, and make its first letter uppercase
Find and replace in a text, such as post title or product attribute value
Clear a text. For example, you can clear a tag’s text to remove it if a certain condition is met.
Limit the number of characters and words in a text or HTML code
Remove empty HTML elements in a text
Remove links targeting specific domains or not targeting specific domains in a text or element
Add something before or after a text
Remove an element from the source code retrieved from the target site
Clone an element
Calculate the numeric values. For example, you can change the price of a product depending on a condition.
Stop crawling a post and delete it from your site if a certain condition is met. For example, you delete the post if the post is not found in the target site when recrawling. Another example is to delete a post if the title or content has a specific word that you do not want in your site.
Set author of the post depending on a condition. For example, you can change the author of the post if the post has a specific category.
Set post status, Add tags, Add categories
Send email notifications. For example, if a condition is satisfied, you can change the post status to pending review and send an email notification to yourself so that you can review and publish it.
Improvement
Import/export Cookies. You can copy the cookie header from the network tab of the developer tools of your browser and import it. See Importing all cookies for more information.
Post Status option contains all the post statuses registered to WordPress.
Options Box opens much faster
Error message displayed when a setting is not configured as expected now displays the path to to problematic setting so that you can understand which setting has to be fixed.
Fix
Test results of a setting that has a File Options Box should not modify the result if the options box does not have any options configured.
WooCommerce options are shown in multi-site installations as well
wpcc/post/source-code/after_retrieve action is not triggered when crawling a category page. Instead, wpcc/category/source-code/after_retrieve action is triggered.
Other
Tested and works with WordPress 5.7, 5.6, 5.5, 5.4, 5.3, 5.2, 5.1, 5.0, 4.9, with PHP 8.0, 7.4, 7.3, 7.2, with Chrome, Firefox, Opera, with WooCommerce 5.1, 5.0, 4.9, 4.8, 4.7, 4.6, 4.5, 4.4, 4.3, 4.2, 4.1, 4.0, 3.9, 3.8, 3.6, 3.3.
Minor fixes and improvements

= v1.10.1 - 25 August 2020 =
### Fix
- Make it compatible with the major changes made in WordPress 5.5. WordPress 5.5 does not include jQuery Migrate, which lets deprecated jQuery functions be used for backward compatibility. This caused the plugin’s some JavaScript features to not work properly. This version removes the usage of any deprecated jQuery functions. Additionally, as instructed by WordPress’s official Test jQuery Updates plugin, the plugin has been thoroughly tested with all of the 4 specified combinations of jQuery, jQuery Migrate, and jQuery UI. This means that the plugin should now be compatible as well with the jQuery changes that will be made in the future WordPress versions.
- Abandon the usage of PHP features deprecated in PHP 7.4.
- Tooltip must not block the underlying UI elements even if it is not visible.
### Other
- Tested and works with WordPress 5.5, 5.4, 5.3, 5.2, 5.1, 5.0, 4.9, with PHP 7.4, 7.3, 7.2, with Chrome, Firefox, Opera, with WooCommerce 4.4, 4.3, 4.2, 4.1, 4.0, 3.9, 3.8, 3.7, 3.6, 3.5.

v1.10.0 
Add bookmark
Apr 12, 2020
Get content from almost any site to your WordPress blog, automatically!

FOR WHAT IT CAN BE USED
Create a personal site which collects news, posts, etc. from your favorite sites to see them in one place
Use it with WooCommerce to collect products from shopping sites
Collect products from affiliate programs to make money
Collect posts to create a test environment for your plugin/theme
Collect plugins, themes, apps, images from other sites to create a collection of them
Keep track of competitors
You can imagine anything. The internet is full of contents

v1.10.0 - 13 February 2020
New
Guides. Interactive guides show you step-by-step how to use the plugin to achieve certain things such as automatically crawling posts, using custom general settings, saving lazy-loading images, saving categories from target post pages, and many more, a total of 20 guides. You can start the guides any time you want. You can even start a guide from any step you want. Guides can be reached by clicking to Guides button shown at the bottom right corner of the pages of the plugin.
TürkçeSpin API, a spinning service used to spin Turkish texts, is added.
Fix
Some parts of the texts are not translated.
Category ID is saved as term name when taxonomy isn’t hierarchical
CSS selectors of some elements cannot be found via Visual Inspector in some cases where one of their parent elements contains more than one class.
Partial translations fr_FR and ko_KR are removed. The plugin currently has only Turkish translations.
Other
Tested and works with WordPress 5.3, 5.2, 5.1, 5.0, 4.9, with PHP 7.4, 7.3, 7.2, with Chrome, Firefox, Opera, Safari, Edge, and with WooCommerce 3.9, 3.8, 3.7, 3.6, 3.5.
Updates third party libraries.
Other small fixes and improvements

v1.9.0 - 13 December 2019
Important
This version requires at least PHP 7.2
New
Spinning (See: Spinning Tab). You can spin the crawled post’s content and other details using Spin Rewriter (See: Spin Rewriter API Options). Note that this is a paid service. You can select what parts of the post should be spun, as well (See: Spinnable Fields).
It is now much easier to find CSS selectors. Visual Inspector can now find CSS selectors in four different modes named as unique, similar, similar (specific) and contains. See Selection behavior for more information.
Translate with Amazon Translate (See: Amazon Translate API Options) and Yandex Translate (See: Yandex Translate API Options) APIs.
Select what types of information should be translated (See: Translatable Fields).
Remove all scripts, empty HTML tags, and HTML comments from all parts of the post by simply checking a few checkboxes. The settings are available under Quick Fixes Section section (See Remove empty HTML elements and comments and Remove scripts settings).
It is now possible to reset the general settings of the plugin. Just click to Reset General Settings button in General Settings Page.
Save all pages of the target post as a single page (See: Save as single page?)
Permissions to limit which user roles can view pages and update settings of the plugin (See: Permissions). The permissions contain wpcc in their name. So, you can look for those in your user role editor plugin.
Detailed documentation that explains features of the plugin with images, videos, and examples and includes several quick tutorials guiding you on how to do certain things.
Improvement
You can save WooCommerce product attributes to WooCommerce’s Attributes page (See: Attribute Name Selectors). If a taxonomy already exists for an attribute, the values of the attributes will be added to already-existing WooCommerce product attributes.
Makes it easy to test categories that are already-defined in site settings. You can select one of the categories in Tester Page.
Options Box is added for Post Date Selectors setting.
Makes it possible to enable/disable setting srcset attributes of saved media elements in the templates. The option is available under Post Tab of General Settings Page (See: Set srcset attributes of saved media when possible).
Save posts as “pending” or “private” (See: Post Status).
You can disable tooltip used throughout the plugin (General Settings > Advanced > Other > Disable Tooltip). By disabling it, you can fix the problem causing the buttons of Manual Crawling Tool to not work.
Fix
Active tabs are not restored in General Settings and Tools pages.
Plugin cannot get the content when there is an invalid URL in the target page’s source code.
URLs are not resolved properly in Visual Inspector.
The last post URL found in a category page has a featured image although it should not.
Infinite loop occurring when the next page URL of the last page of a post points to the first page of the post.
Translation test results are not shown when the test text is too long.
Other
Tested and works in WordPress 5.3, 5.2, 5.1, 5.0, 4.9, in PHP 7.4, 7.3, 7.2, in Chrome, Firefox, Opera, Safari, Edge, and with WooCommerce 3.8, 3.7, 3.6, 3.5.
Updates third party libraries.
Other small fixes and improvements
Requires at least PHP 7.2, which is the oldest actively-supported version. See: Supported Versions at PHP.net.