3. Guides

This section contains several guides explaining how to do certain things by using the plugin. These are just a collection of the instructions already available in the documentation. Not everything that can be done in the plugin is listed here. Although the names of the settings of WP Content Crawler are generally self-explanatory, you can refer to the documentations of the settings if you cannot find the guide you are looking for here.

Interactive guides

The plugin has interactive guides as well. You can reach the interactive guides by clicking to Guides button shown at the bottom right corner of the pages of the plugin. To start the guide or one of its steps, just click its play button. Note that not every guide listed here is available as an interactive guide. So, if you cannot find the guide you are looking for as an interactive guide, you can check this page to see if it is available here.

Contents

• 3.1. Creating site settings to crawl a site
• 3.2. Saving posts automatically
  • 3.2.1. Disabling automatic saving for all sites
• 3.3. Updating posts automatically
  • 3.3.1. Disabling recrawling for all sites
• 3.4. Translating posts automatically
  • 3.4.1. Disabling translation for all sites
• 3.5. Spinning posts automatically
  • 3.5.1. Disabling spinning for all sites
• 3.6. Deleting posts automatically
  • 3.6.1. Disabling deleting for all sites
• 3.7. Using cookies
• 3.8. Importing all cookies of a site
• 3.9. Adding request headers
• 3.10. Importing request headers from browser
• 3.11. Increasing speed of tests in site settings page
• 3.12. Using custom general settings for a site
• 3.13. Adding category URLs automatically
• 3.14. Duplicating site settings
• 3.15. Manually saving posts
• 3.16. Manually updating posts
• 3.17. Tracking saved posts
• 3.18. Getting notified when selectors cannot find a value
• 3.19. Testing site settings
• 3.20. Collecting post URLs from multiple pages of a category
• 3.21. Saving multi-page posts
• 3.22. Saving list-type posts
• 3.23. Saving post meta (custom fields)
• 3.24. Saving taxonomy values
• 3.25. Creating post categories automatically
• 3.26. Saving posts as custom post types
• 3.27. Disabling fixed navigation and tabs in site settings page
• 3.28. Saving post title
• 3.29. Saving post excerpt
• 3.30. Saving post content
• 3.31. Saving post tags
• 3.32. Saving post permalink (slug)
• 3.33. Saving post date
• 3.34. Saving the featured image of a post
• 3.35. Saving images in post content
• 3.36. Saving lazy-loaded images
• 3.37. Defining custom short codes to use anything in templates
• 3.38. Saving WooCommerce products
• 3.39. Saving featured images from category pages
• 3.40. Defining how posts are marked as duplicate
• 3.41. Adding/removing things to/from post content
• 3.42. Adding/removing things to/from post title
• 3.43. Adding/removing things to/from post excerpt
• 3.44. Saving posts as draft or pending (defining post status)
• 3.45. Setting the author of the posts
• 3.46. Removing the links in post content
• 3.47. Showing iframes in post content
• 3.48. Showing scripts in post content
• 3.49. Creating a gallery of images or files in post content
• 3.50. Taking notes about site settings
• 3.51. Changing something in every page of every site
• 3.52. Removing an HTML element from post content
• 3.53. Dealing with character encoding problems
• 3.54. Using proxies
• 3.55. Adding/removing/changing things in target page
• 3.56. Limiting maximum tags posts can have
• 3.57. Setting password to posts
• 3.58. Setting HTTP User Agent and HTTP Accept values
• 3.59. Manually adding post URLs
• 3.60. Deleting post URLs of a site
• 3.61. Deleting a post when it is not found when recrawling
• 3.62. Assigning a featured image from media library
  • 3.62.1. Assigning a fallback featured image
• 3.63. Disabling SSL verification for a site
• 3.64. Inserting text/HTML into the middle of the post content
• 3.65. Using ChatGPT