3. Guides

This section contains several guides explaining how to do certain things using the plugin. These are just a collection of the instructions already available in the documentation. Not everything that can be done in the plugin is listed here. Although the names of the settings of WP Content Crawler are generally self-explanatory, you can refer to the documentations of the settings if you cannot find the guide you are looking for here.

Contents

• 3.1. Creating site settings to crawl a site
• 3.2. Saving posts automatically
  • 3.2.1. Disabling automatic saving for all sites
• 3.3. Updating posts automatically
  • 3.3.1. Disabling recrawling for all sites
• 3.4. Translating posts automatically
  • 3.4.1. Disabling translation for all sites
• 3.5. Spinning posts automatically
  • 3.5.1. Disabling spinning for all sites
• 3.6. Deleting posts automatically
  • 3.6.1. Disabling deleting for all sites
• 3.7. Using cookies
• 3.8. Increasing speed of tests in site settings page
• 3.9. Using custom general settings for a site
• 3.10. Adding category URLs automatically
• 3.11. Duplicating site settings
• 3.12. Manually saving posts
• 3.13. Manually updating posts
• 3.14. Tracking saved posts
• 3.15. Getting notified when selectors cannot find a value
• 3.16. Testing site settings
• 3.17. Collecting post URLs from multiple pages of a category
• 3.18. Saving multi-page posts
• 3.19. Saving list-type posts
• 3.20. Saving post meta (custom fields)
• 3.21. Saving taxonomy values
• 3.22. Creating post categories automatically
• 3.23. Saving posts as custom post types
• 3.24. Disabling fixed navigation and tabs in site settings page
• 3.25. Saving post title
• 3.26. Saving post excerpt
• 3.27. Saving post content
• 3.28. Saving post tags
• 3.29. Saving post permalink (slug)
• 3.30. Saving post date
• 3.31. Saving the featured image of a post
• 3.32. Saving images in post content
• 3.33. Saving lazy-loaded images
• 3.34. Defining custom short codes to use anything in templates
• 3.35. Saving WooCommerce products
• 3.36. Saving featured images from category pages
• 3.37. Defining how posts are marked as duplicate
• 3.38. Adding/removing things to/from post content
• 3.39. Adding/removing things to/from post title
• 3.40. Adding/removing things to/from post excerpt
• 3.41. Saving posts as draft or pending (defining post status)
• 3.42. Setting the author of the posts
• 3.43. Removing the links in post content
• 3.44. Showing iframes in post content
• 3.45. Showing scripts in post content
• 3.46. Creating a gallery of images or files in post content
• 3.47. Taking notes about site settings
• 3.48. Changing something in every page of every site
• 3.49. Removing an HTML element from post content
• 3.50. Dealing with character encoding problems
• 3.51. Using proxies
• 3.52. Adding/removing/changing things in target page
• 3.53. Limiting maximum tags posts can have
• 3.54. Setting password to posts
• 3.55. Setting HTTP User Agent and HTTP Accept values
• 3.56. Manually adding post URLs
• 3.57. Deleting post URLs of a site