the scrapper is stopping after scrapping few chapters

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

Tagged: 

This topic has 15 replies, 2 voices, and was last updated 2 months, 4 weeks ago by Szabi – CodeRevolution.

Viewing 15 reply threads
  • Author
    Posts

    • September 11, 2025 at 5:18 pm #12446


      zekiman
      Participant
      Post count: 7

      Hi, so I have increased my server Max execution time to 99999 and still after scrapping few chapters somewhere in between 15,20 chapters of the manga it stops and I dont know why it is stopping because I dont see any error in the logs, it just stops and it runs again when its scheduled and then again it will do the same and gets stop.

      is it made like this like it will stop scraping after every few chapters ?

    • September 11, 2025 at 5:28 pm #12447


      Szabi – CodeRevolution
      Keymaster
      Post count: 5080

      Hello,

      If you already increased the max_execution_time variable on your server to a large value, however, the processing is still interrupted after a period of time, I suspect that your hosting provider has a hardcoded max_execution_time value which they enforce on your server (for example to 240 seconds).

      To check on this, please ask your hosting provider’s support if they have any hardcoded execution_time_limitation on the server or if they have any server side timeouts when executing long running ajax jobs. If they have this, please ask them to remove this limitation from your server.

      Please check on this with them.

      Regards,
      Szabi – CodeRevolution

    • September 11, 2025 at 6:26 pm #12451


      zekiman
      Participant
      Post count: 7

      Well I am talking with my hosting provider, they aint very helpful.

      one other thing I want to know about like I have added 20 manga in the the Madara theme sites scrapper section and I have given all the schedule of 1 hour but when I am checking some manga have been last scrapped since 6hr,7hr since last scrapped.

      I know it’s syncronus scrapping so shouldn’t it work like after every hour ? because right now my scrapping for each manga is stopping after 4 minutes so I dont understand why its still showing last scrapped since 6hr etc.

      so in the logs I am seeing whenever scrapping resumes for a manga which I have scrapped some chapters before it always starts from the first chapter , It doesnt publish it but it does start from 1st chapter every time which is basically a waste of time, so is there some setting I can enable so it checks for the last scrapped chapter and continues from there.

    • September 11, 2025 at 6:40 pm #12453


      Szabi – CodeRevolution
      Keymaster
      Post count: 5080

      Hello,

      The plugin’s execution is fully stopped by your server after 20 chapters, because of this, other manga will not manage to be published also. If current hosting provider is not helpful, I suggest changing hosting provider and migrating your site to a VPS hosting.

      Also, scraping and continuing from last scraped chapter is a good idea, for this, please enable the ‘Cache Items For Continuous Posting’ checkbox in rule settings.

      Regards,
      Szabi – CodeRevolution.

    • September 11, 2025 at 6:43 pm #12454


      zekiman
      Participant
      Post count: 7

      Yes, so I am using namecheap hosting and they admit its an issue on their side and will let me know when they fix it and if not fixed within next two days I will move to a vps and also one more thing is that like all the sites build on top of Madara they dont have manga , most of them have only manga.
      does the scrapper support any website from which I scrap at least the og manga like Naruto, one piece etc.

    • September 11, 2025 at 6:49 pm #12455


      Szabi – CodeRevolution
      Keymaster
      Post count: 5080

      Yes, most of the sites are supported.

    • September 11, 2025 at 6:51 pm #12456


      zekiman
      Participant
      Post count: 7

      can you please tell me how to scrap using keywords, like I wrote there Naruto it didn’t scrap and I saw the yellow line.

      plus is the asurascan scrap supported or manganelo or mangakaklot?

    • September 11, 2025 at 6:54 pm #12457


      Szabi – CodeRevolution
      Keymaster
      Post count: 5080

      I suggest you add the full manga URL for Naruto, from a Madara themed site.

    • September 12, 2025 at 6:30 am #12458


      zekiman
      Participant
      Post count: 7

      scraping and continuing from last scraped chapter is a good idea, for this, please enable the ‘Cache Items For Continuous Posting’ checkbox in rule settings.

      I am not able to find this option can you send me a ss or something like where exactly I can find this

    • September 12, 2025 at 8:06 am #12459


      Szabi – CodeRevolution
      Keymaster
      Post count: 5080

      This is available only in the Fanfox scraper part of the plugin, I noted to make this feature available also in the Generic Manga scraper part, in upcoming updates.

      Regards.

    • September 13, 2025 at 7:10 am #12461


      zekiman
      Participant
      Post count: 7

      Hi, so I am moving to the vps and I have setup the vps and I am trying to activate the plugin but I am getting this error

      Error in registration process: Plugin is already registered on another domain, please revoke it to move the license to this new domain: http://mangaloom.com

      even though on the previous one I have already revoked the license and if I add the purchase code there again it works there but not in this new one.

    • September 13, 2025 at 7:21 am #12462


      Szabi – CodeRevolution
      Keymaster
      Post count: 5080

      I revoked your purchase code from your old site, you can activate it now on the new one.

      Regards.

    • September 14, 2025 at 8:26 pm #12469


      zekiman
      Participant
      Post count: 7

      can you let me know why I am getting this error

      Exit error: Uncaught TypeError: stristr(): Argument #1 ($haystack) must be of type string, array given in /var/www/html/wordpress/wp-content/plugins/ultimate-manga-scraper/ultimate-manga-scraper.php:11274 Stack trace: #0 /var/www/html/wordpress/wp-content/plugins/ultimate-manga-scraper/ultimate-manga-scraper.php(11274): stristr() #1 /var/www/html/wordpress/wp-content/plugins/ultimate-manga-scraper/ultimate-manga-scraper.php(1395): ums_run_rule() #2 /var/www/html/wordpress/wp-includes/class-wp-hook.php(324): ums_cron() #3 /var/www/html/wordpress/wp-includes/class-wp-hook.php(348): WP_Hook->apply_filters() #4 /var/www/html/wordpress/wp-includes/plugin.php(565): WP_Hook->do_action() #5 /var/www/html/wordpress/wp-cron.php(191): do_action_ref_array() #6 {main} thrown, file: /var/www/html/wordpress/wp-content/plugins/ultimate-manga-scraper/ultimate-manga-scraper.php, line: 11274 – rule ID: 0!

    • September 15, 2025 at 4:48 am #12473


      Szabi – CodeRevolution
      Keymaster
      Post count: 5080

      Please update the plugin to the latest available version v2.0.3 and check if this issue is solved.

      Regards.

    • September 16, 2025 at 8:01 pm #12493


      zekiman
      Participant
      Post count: 7

      Hi, can you let me know how soon can you add the cache functionality into the Madara theme scrapper one, because my scrapper spends most of the time scrapping the already scraped one

    • September 16, 2025 at 8:39 pm #12494


      Szabi – CodeRevolution
      Keymaster
      Post count: 5080

      Send me an email with this and i check on it. My email is kisded@yahoo.com

  • Author
    Posts
Viewing 15 reply threads

The topic ‘the scrapper is stopping after scrapping few chapters’ is closed to new replies.