problem in Crawlomatic scrap

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

This topic has 1 reply, 2 voices, and was last updated 3 years, 2 months ago by Szabi – CodeRevolution.

Viewing 1 reply thread
  • Author
    Posts

    • October 19, 2021 at 1:03 am #3973


      ahmedsaqqa
      Participant
      Post count: 1

      Crawlomatic too slowly in scrape ..

       

      if i want scrape 500 post it take more 60 min .. there is any recommended sitting to the server or its original take a lot of time

    • October 19, 2021 at 7:16 am #3974


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Hello,

      First of all, thank you for your purchase.

      In cases of large amounts of scraping, the plugin’s importing speed is also limited by your server’s processing speed, CPU performance, memory amount and network speed. Please check on these and increase server performance if possible.

      Also, please check this tutorial video: https://www.youtube.com/watch?v=2jWf0gemMms – it shows how to reduce the query count to scraped websites, this will allow the plugin to scrape content more efficiently. Please follow the settings steps shown in the above video.

      Also, you will need to increase max_execution_time in server settings, to allow uninterrupted execution: https://code.tutsplus.com/tutorials/how-to-increase-max_execution_time-in-php–cms-37017

      Regards, Szabi – CodeRevolution.

  • Author
    Posts
Viewing 1 reply thread

The topic ‘problem in Crawlomatic scrap’ is closed to new replies.