3.2. Saving posts automatically

To save posts automatically, do the following:

Tip

For a more detailed explanation, please see Crawling your first site.

  1. Create a new site in the plugin (See: Creating a New Site)
  2. Go to Main Tab
  3. Fill Site URL
  4. Check Active for scheduling? checkbox
  5. Go to Category Tab
  6. Enter at least one category URL into Category URLs
  7. In Category URL Selectors setting, define at least one CSS selector that finds URLs of the posts in the category page whose URL was entered into Category URLs
  8. Go to Post Tab
  9. Enter at least one CSS selector into Post Title Selectors setting
  10. Enter at least one CSS selector into Post Content Selectors setting
  11. Publish the site settings (See: Saving The Settings)
  12. Go to General Settings Page and activate Scheduling Tab
  13. Check Scheduling is active? setting’s checkbox
  14. Select time intervals in Post URL Collection Interval and Post Crawl Interval settings
  15. Save the general settings

After these steps are done, the posts found in the category page you defined in Category URLs will be saved automatically into your site in the time intervals you defined. With these settings, only the title and the content of the posts will be saved. If you want to save other parts of the posts, you can configure other options under Post Tab.

Tip

You can observe the active sites and the posts that were crawled from Dashboard Page.

3.2.1. Disabling automatic saving for all sites

Go to General Settings Page and activate Scheduling Tab. Then, uncheck Scheduling is active? setting’s checkbox and save the general settings. This will disable automatic crawling for all sites.