6.5. Lifecycle of Events

This section contains the lifecycle of events such as URL collection, crawling, and recrawling events. The lifecycle term refers to the order of application of, e.g., settings defined by you. The lifecycle of the events are given so that you can feel more comfortable while using the settings. If you know which setting is applied when, you have a deeper understanding of the settings and how to use them.

6.5.1. URL Collection Event

The list below shows the order of application of the settings when collecting post URLs from category pages.

1. Make a request to the target URL by adding Cookies and get the source code

2. Find and replace in raw HTML

3. Event: “After category request is made” (filters registered to this event)

   Note

   The rest of the items will not be executed if there is an error at this point, such as a “page not found” error or HTML parsing errors.

4. Find and replace in all post pages (in General Settings Page)

5. Find and replace in HTML at first load

6. Find and replace in element attributes

7. Exchange element attributes

8. Remove element attributes

9. Find and replace in element HTML

10. Unnecessary Element Selectors

11. Resolve relative URLs existing in the source code

12. Event: “After category crawler is ready” (filters registered to this event)

13. Category Post URL Selectors

14. Prepare featured images

    1. Featured Image Selectors
    2. Find and replace in featured image URL
    3. Post links come before featured images?

15. Collect URLs in reverse order?

16. Category Next Page URL Selectors

17. Event: “When the category data is ready” (filters registered to this event)

18. CSS selectors for empty value notification

6.5.2. Post Crawl and Recrawl Event

The list below shows the order of application of the settings when crawling and recrawling a post.

Note

Certain details are not saved when recrawling. For more information, please refer to Recrawling Section.

1. Make a request to the target URL by adding Cookies and get the source code

2. Find and replace in raw HTML

3. Event: “After post request is made” (filters registered to this event)

   Note

   The rest of the items will not be executed if there is an error at this point, such as a “page not found” error or HTML parsing errors.

4. Find and replace in all post pages (in General Settings Page)

5. Find and replace in HTML at first load

6. Find and replace in element attributes

7. Exchange element attributes

8. Remove element attributes

9. Find and replace in element HTML

10. Resolve relative URLs existing in the source code

11. Prepare pagination information by using the settings defined in Pagination Section

12. Remove unnecessary elements by using the selectors defined in Unnecessary Element Selectors

13. Event: “After post crawler is ready” (filters registered to this event)

14. Prepare post title

    1. Post Title Selectors
    2. Find and replace in post’s title

15. Post Slug (Permalink) Selectors

16. Prepare post excerpt

    1. Post Excerpt Selectors
    2. Find and replace in post’s excerpt

17. Post Content Selectors

18. Prepare categories

    1. Category Name Selectors
    2. Category Name Separators

19. Prepare publish date

    1. Post Date Selectors
    2. Find and replace in dates
    3. Minutes that should be added to the final date

20. Prepare custom short codes

    1. Custom Content Selectors for Shortcodes
    2. Find and replace in custom short codes
    3. Find and replace in custom short code contents

21. Prepare list-type post information by using the settings under List Type Posts Section

22. Prepare post tag and meta information

    1. Post Tag Selectors
    2. Save meta keywords?
    3. Find and replace in meta keywords
    4. Add meta keywords as tags?
    5. Find and replace in post’s each tag
    6. Save meta description?

23. Prepare custom post meta

    1. Custom Meta Selectors
    2. Custom Meta
    3. Find and replace in custom meta

24. Prepare taxonomies

    1. Custom Taxonomy Value Selectors
    2. Custom Taxonomy Value

25. Prepare and save media files

    1. Featured Image Selectors
    2. Find and replace in featured image URL
    3. Gallery Image URL Selectors
    4. Image URL Selectors
    5. Save all images in the post content?
    6. Find and replace in image URLs
    7. Save the found files

26. Save WooCommerce product details by using the settings defined under WooCommerce Section

27. Prepare the templates

    1. Post Title Template
    2. Post Excerpt Template
    3. List Item Template
    4. Remove links from short codes?
    5. Convert iframe elements to short code
    6. Convert script elements to short code
    7. Gallery Item Template
    8. Main Post Template
    9. Template Unnecessary Element Selectors
    10. Find and replace in post’s content
    11. Replace short codes that are defined by the plugin in all templates

28. Prepare the post data

    1. Remove empty HTML elements and comments
    2. Remove scripts

29. Event: “When the post data is ready” (filters registered to this event)

30. Translate the selected contents (Translatable Fields) by using the selected translation service (Translate with)

31. Event: “After translation” (filters registered to this event)

32. Spin the selected contents (Spinnable Fields) by using the selected spinning service (Spin with)

33. Event: “After spinning” (filters registered to this event)

34. CSS selectors for empty value notification