Slow down crawling or limit usage.

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

Viewing 1 reply thread
  • Author
    Posts
    • #4727


      chinu.ramraika
      Participant

      I have cloud hosting from hostinger and i am using it for my website. It has been a while since i am using your plugin and all is good only problem is that takes too much toll on my server even when i have reduced the no of posts per crawl. After talking to hostinger support they told my to find a way to slow down the crawler speed so that it doesn’t peak the ram usage.

      I would really appreciate it if you could help me adjust the plugin so that it doesn’t exceed hosting usage.

      It’s a multisite installation with main domain vagarylife.com and indexofnews.com as sub-site.

      You can visit indexofnews.com/wp-login.php and i have created a editor credentials for you to take a look and set. Please email me so that i can provide it to you.

      Attachments:
      You must be logged in to view attached files.
    • #4729


      Szabi – CodeRevolution
      Keymaster
      Post count: 4193

      Hello,

      First of all, thank you for your purchase.

      To ease the CPU load, I recommend to spread rule running to different periods. To do this, please change the schedule of the runs from 4 hours (all) to 4,5,6,7,8 hours each (the rules should have a different schedule, so they run after each other, not all at a time).

      Also, I recommend you set in the plugin’s ‘Main Settings’ -> ‘Delay Between Multiple Requests – Global Settings – (milliseconds)’ settings field -> 300,500

      This will make the plugin wait a random interval, between 300 and 500 milliseconds, after each request it makes, allowing the server to have more free time for other processing operations.

      Regards, Szabi – CodeRevolution.

Viewing 1 reply thread

The topic ‘Slow down crawling or limit usage.’ is closed to new replies.