6.6. Lifecycle of Events

This section contains the lifecycle of events such as URL collection, crawling, and recrawling events. The lifecycle term refers to the order of application of, e.g., settings defined by you. The lifecycle of the events are given so that you can feel more comfortable while using the settings. If you know which setting is applied when, you have a deeper understanding of the settings and how to use them.

6.6.1. URL Collection Event

The list below shows the order of application of the settings when collecting post URLs from category pages.

1. Make a request to the target URL by adding Cookies and get the source code

2. Find and replace in raw HTML

3. Event: “After category request is made” (The filters registered to this event are executed)

   Note

   The rest of the items will not be executed if there is an error at this point, such as a “page not found” error or HTML parsing errors.

4. Find and replace in all post pages (in General Settings Page)

5. Find and replace in HTML at first load

6. Find and replace in element attributes

7. Exchange element attributes

8. Remove element attributes

9. Find and replace in element HTML

10. Convert JSON to HTML

11. Convert JSON to HTML automatically?

12. Unnecessary Element Selectors

13. Resolve relative URLs existing in the source code

14. Event: “After category crawler is ready” (The filters registered to this event are executed)

15. Post URL Selectors

16. Prepare featured images

    1. Featured Image Selectors
    2. Find and replace in featured image URL
    3. Post links come before featured images?

17. Collect URLs in reverse order?

18. Next Page URL Selectors

19. Event: “When the category data is ready” (The filters registered to this event are executed)

20. CSS selectors for empty value notification

6.6.2. Post Crawl and Recrawl Event

The list below shows the order of application of the settings when crawling and recrawling a post.

Note

Certain details are not saved when recrawling. For more information, please refer to Recrawling Section.

1. Make a request to the target URL by adding Cookies and get the source code

2. Find and replace in raw HTML

3. Event: “After post request is made” (The filters registered to this event are executed)

   Note

   The rest of the items will not be executed if there is an error at this point, such as a “page not found” error or HTML parsing errors.

4. Find and replace in all post pages (in General Settings Page)

5. Find and replace in HTML at first load

6. Find and replace in element attributes

7. Exchange element attributes

8. Remove element attributes

9. Find and replace in element HTML

10. Convert JSON to HTML

11. Convert JSON to HTML automatically?

12. Resolve relative URLs existing in the source code

13. Prepare pagination information by using the settings defined in Pagination Section

14. Remove unnecessary elements by using the selectors defined in Unnecessary Element Selectors

15. Event: “After post crawler is ready” (The filters registered to this event are executed)

16. Prepare post title

    1. Post Title Selectors
    2. Find and replace in post’s title

17. Post Slug (Permalink) Selectors

18. Prepare post excerpt

    1. Post Excerpt Selectors
    2. Find and replace in post’s excerpt

19. Post Content Selectors

20. Prepare categories

    1. Category Name Selectors
    2. Category Name Separators

21. Prepare custom short codes

    1. Custom Short Code Selectors
    2. Find and replace in custom short codes
    3. Find and replace in custom short code contents

22. Prepare publish date

    1. Post Date Selectors
    2. Find and replace in dates
    3. Minutes that should be added to the final date

23. Prepare list-type post information by using the settings under List Type Posts Section

24. Prepare post tag and meta information

    1. Post Tag Selectors
    2. Save meta keywords?
    3. Find and replace in meta keywords
    4. Add meta keywords as tags?
    5. Find and replace in post’s each tag
    6. Save meta description?

25. Prepare custom post meta

    1. Custom Meta Selectors
    2. Custom Meta
    3. Find and replace in custom meta

26. Prepare taxonomies

    1. Custom Taxonomy Value Selectors
    2. Custom Taxonomy Value

27. Prepare and save media files

    1. Featured Image Selectors
    2. Find and replace in featured image URL
    3. Gallery Image URL Selectors
    4. Image URL Selectors
    5. Save all images in the post content?
    6. Find and replace in image URLs
    7. Save the found files

28. Save WooCommerce product details by using the settings defined under WooCommerce Section

29. Prepare the templates

    1. Post Title Template
    2. Post Excerpt Template
    3. List Item Template
    4. Remove links?
    5. Convert iframe elements to short code
    6. Convert script elements to short code
    7. Gallery Item Template
    8. Post Content Template
    9. Template Unnecessary Element Selectors
    10. Find and replace in post’s content
    11. Replace short codes that are defined by the plugin in all templates

30. Prepare the post data

    1. Embed social media posts and other media
    2. Remove empty HTML elements and comments
    3. Remove scripts

31. Event: “When the post data is ready” (The filters registered to this event are executed)

32. Translate the selected contents (Translatable Fields) by using the selected translation service (Translate with)

33. Event: “After translation” (The filters registered to this event are executed)

34. Spin the selected contents (Spinnable Fields) by using the selected spinning service (Spin with)

35. Event: “After spinning” (The filters registered to this event are executed)

36. CSS selectors for empty value notification