5.5. Lifecycle of Events

This section contains the lifecycle of events such as URL collection, crawling, and recrawling events. The lifecycle term refers to the order of application of, e.g., settings defined by you. The lifecycle of the events are given so that you can feel more comfortable using the settings. If you know which setting is applied when, you have a deeper understanding of the settings and how to use them.

5.5.2. Post Crawl and Recrawl Event

The list below shows the order of application of the settings when crawling and recrawling a post.

Note

Certain details are not saved when recrawling. For more information, please refer to Recrawling Section.

  1. Make a request to the target URL by adding Cookies and get the source code
  2. Find and replace in raw HTML
  3. Find and replace in all post pages (in General Settings Page)
  4. Find and replace in HTML at first load
  5. Find and replace in element attributes
  6. Exchange element attributes
  7. Remove element attributes
  8. Find and replace in element HTML
  9. Resolve relative URLs existing in the source code
  10. Prepare pagination information using the settings defined in Pagination Section
  11. Remove unnecessary elements using the selectors defined in Unnecessary Element Selectors
  12. Prepare post title
    1. Post Title Selectors
    2. Find and replace in post’s title
  13. Post Slug (Permalink) Selectors
  14. Prepare post excerpt
    1. Post Excerpt Selectors
    2. Find and replace in post’s excerpt
  15. Post Content Selectors
  16. Prepare categories
    1. Category Name Selectors
    2. Category Name Separators
  17. Prepare publish date
    1. Post Date Selectors
    2. Find and replace in dates
    3. Minutes that should be added to the final date
  18. Prepare custom short codes
    1. Custom Content Selectors for Shortcodes
    2. Find and replace in custom short codes
    3. Find and replace in custom short code contents
  19. Prepare list-type post information using the settings under List Type Posts Section
  20. Prepare post tag and meta information
    1. Post Tag Selectors
    2. Save meta keywords?
    3. Find and replace in meta keywords
    4. Add meta keywords as tags?
    5. Find and replace in post’s each tag
    6. Save meta description?
  21. Prepare custom post meta
    1. Custom Meta Selectors
    2. Custom Meta
    3. Find and replace in custom meta
  22. Prepare taxonomies
    1. Custom Taxonomy Value Selectors
    2. Custom Taxonomy Value
  23. Prepare and save media files
    1. Featured Image Selectors
    2. Find and replace in featured image URL
    3. Gallery Image URL Selectors
    4. Image URL Selectors
    5. Save all images in the post content?
    6. Find and replace in image URLs
    7. Save the found files
  24. Save WooCommerce product details using the settings defined under WooCommerce Section
  25. Prepare the templates
    1. Post Title Template
    2. Post Excerpt Template
    3. List Item Template
    4. Remove links from short codes?
    5. Convert iframe elements to short code
    6. Convert script elements to short code
    7. Gallery Item Template
    8. Main Post Template
    9. Template Unnecessary Element Selectors
    10. Find and replace in post’s content
    11. Replace short codes that are defined by the plugin in all templates
  26. Prepare the post data
    1. Remove empty HTML elements and comments
    2. Remove scripts
  27. Translate the selected contents (Translatable Fields) using the selected translation service (Translate with)
  28. Spin the selected contents (Spinnable Fields) using the selected spinning service (Spin with)
  29. CSS selectors for empty value notification