Manga Scraper – Downloading All Chapters

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

This topic has 1 reply, 2 voices, and was last updated 2 years, 1 month ago by Szabi – CodeRevolution.

Viewing 1 reply thread
  • Author
    Posts
    • #6106


      nivelerua
      Participant

      Hey,

      Awesome script. It’s working well for me.

      Is there a way to download the whole manga when you run it for the first time? Currently, adding manga titles from Fanfox is a bit challenging because of this limitation. If I set it to download 10 chapters every hour, then it will take a while to get the whole series. Imagine if I have 2K chapters to download from the Fanfox website, it will take me 200hrs to download the whole thing.  Unless I am missing something in the main settings to allow this.

      Feature request:

      1. allow us to change the “Manage Author” for Bulk Change or set a default Author area under Main Settings just like the Default Max Chapter, Schedule Rule,  Max Manga to scrape”.
      2. when adding a link to scrape, can I do bulk add? Right now, I have to save it first before I can add the next title I want.  I think it will be nicer to add a (+) to add new a line.

      The Feature request is not a big deal but the main question is the downloading the whole series

      please advise.

      Thank you!

    • #6109


      Szabi – CodeRevolution
      Keymaster
      Post count: 4577

      Hello,

      First of all, thank you for your purchase.

      To download multiple manga also with full chapters, I recommend you increase the ‘Max # Chapters’ settings field to a very large value, like 10000. This will allow the plugin to process a large number of chapters in a single run of the plugin. In this case, you might need to set the ‘Schedule’ parameter to a larger value than 1 hour, like 3 or 4 hours, to allow the plugin to finish scraping of chapters before it starts its next scheduled cycle again.

      Also, if you use a keyword search query to search for manga, you can increase the maximum number of manga which will be scraped in the ‘Maximum Number Of Manga to Scrape’ settings field of rules (visible if you click ‘Settings’ for rules).

      Also, for the above to work properly, you need to edit your server settings, you need to increase the max_execution_time server variable to a very large value. This is a server settings which stops execution of scripts which run on your server automatically, after a period of seconds, which is set to the value of this settings. I recommend you set it to 16000 or to a larger value. Please check this tutorial for info on how to do this: https://www.simplified.guide/php/increase-max-execution-time

      Also, I noted your suggestions, will add them to the next plugin update. Regarding multiple keywords or URLs, in the next update you will be able to add multiple keywords or URLs separated by commas. Also, will think on how to add a default author field. Please check the next plugin update for these new features.

      Regards, Szabi – CodeRevolution.

Viewing 1 reply thread

The topic ‘Manga Scraper – Downloading All Chapters’ is closed to new replies.