Ultimate Web Novel and Manga Scraper

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

This topic has 9 replies, 2 voices, and was last updated 2 years, 4 months ago by Szabi – CodeRevolution.

Viewing 9 reply threads
  • Author
    Posts

    • July 23, 2022 at 3:20 pm #5567


      Noogardpt
      Participant
      Post count: 4

      I’m scraping the novels but the featured images are not scraped. Is there something wrong with my setup?

    • July 23, 2022 at 3:30 pm #5568


      Szabi – CodeRevolution
      Keymaster
      Post count: 4577

      Hello,

      First of all, thank you for your purchase.

      Please be sure to use the latest plugin version v1.0.9 as it fixed the featured image issue you encountered.

      Let me know if it helped.

      Regards, Szabi – CodeRevolution.

    • July 23, 2022 at 3:38 pm #5569


      Noogardpt
      Participant
      Post count: 4

      Hi Szabi,

      Thank you so much for the quick reply. I just downloaded from codecanyon about an hour ago. Would that be the latest version?

       

       

    • July 23, 2022 at 5:03 pm #5570


      Szabi – CodeRevolution
      Keymaster
      Post count: 4577

      Hello,

      Interesting, it should be latest version.

      Can you send me, please, temporary admin login credentials to your WordPress install, so I can check this issue out? Send it, please, to my email address: kisded@yahoo.com

      Regards, Szabi – CodeRevolution.

    • July 25, 2022 at 1:57 am #5581


      Noogardpt
      Participant
      Post count: 4

      Hi Szabi, hailongpt@gmail.com here, just sent you the admin access. Can you help me check why it won’t scrape the image for many novels? Also I’m trying to scrape about 2000 titles, but they isually time out and they dont automatically run again.

      Also some of the titles are scraped twice aka duplicated novels 🙁

    • July 25, 2022 at 5:49 am #5582


      Szabi – CodeRevolution
      Keymaster
      Post count: 4577

      Hello,

      I logged in to your site and check on these issues.

      I updated the plugin to v1.1.0 to fix the featured image problems, now images should be able to be scraped correctly, please check. Let me know if this helped.

      Regarding the 2000 titles issue, in this case, WordPress.com has a maximum number of seconds it allows my plugin to run, which is hardcoded in their server settings. Currently, on your server, this is set to 1200 seconds, which means 20 minutes. If the plugin takes more than 20 minutes to execute, it will be forcefully stopped by WordPress.com.

      On a self managed hosting of WordPress, this can be changed from PHP settings, however, on a WordPress.com site changing this settings is not possible, because they don’t allow you to change this settings.

      I recommend you import a lower number of novels in a single plugin run and make importing to be spread out to multiple time intervals (changing the ‘Schedule’ parameter of rules to multiple values, to rules will run grouped, on a separate time intervals / hours). This will solve also the duplication issue.

      I hope this info helps.

      Regards,

      Szabi – CodeRevolution.

    • July 25, 2022 at 9:46 am #5584


      Noogardpt
      Participant
      Post count: 4

      Hi Szabi, works wonder now!!

      Just one question from me, I’m scraping and some of the novel they miss out some chapters in the middle (like chap 1,2 then jump to chap 10) -> How can I fix this? 😀

       

    • July 25, 2022 at 9:49 am #5585


      Szabi – CodeRevolution
      Keymaster
      Post count: 4577

      Glad to help!

      Please send me novel URL which is missing and I check it on my part.

      Regards.

    • July 25, 2022 at 9:51 am #5586


      Noogardpt
      Participant
      Post count: 4

      https://freewuxia.com/manga/cultivation-my-augmented-statuses-have-unlimited-duration/ You can help check this one for example 😀

    • July 25, 2022 at 10:21 am #5587


      Szabi – CodeRevolution
      Keymaster
      Post count: 4577

      I checked and currently I don’t have a solution for this, as the plugin is reproducing content 1:1 from the scraped sites.

      I will think on this, however, changing chapter names is not a solution, as the order of chapters would break.

      I can recommend scraping these novels from alternative sources, if available.

      However, I will continue to think on this.

      Regards.

  • Author
    Posts
Viewing 9 reply threads

The topic ‘Ultimate Web Novel and Manga Scraper’ is closed to new replies.