Wildcard usage in Ultimate Web Novel and Manga Scraper

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

Tagged: , ,

This topic has 15 replies, 2 voices, and was last updated 1 year, 1 month ago by Szabi – CodeRevolution.

Viewing 15 reply threads
  • Author
    Posts

    • October 29, 2023 at 5:09 pm #8949


      Sankalan
      Participant
      Post count: 16

      Hi there,

      I purchased your Ultimate Web Novel and Manga Scraper plugin.

      It is a lovely plugin.

      However, I need support with setting up wildcard (*) for web novels.

      It is really not possible to create a long list of comma-separated URLs or possible keywords and use them for scraping.

      Using wildcard (*) is a much more logical approach and I see that the plugin supports wildcard (*) for web novels.

      How do I set up a wildcard using a URL?

      I tried something like this: https://newnovel.org/novel/*.

      It did not work.

      Is that even a right way of setting up a wildcard rule? I don’t know.

      Your video walkthrough didn’t show anything on wildcard usage.

      So, please help me set up that rule so that I can make the plugin scrape all novels on a supported site.

      ———————————–

      ———————————–

      Another question:

      Two different sites (suppose A & B) can have the same novel.

      If I scrape the novel from site A and then set up a scraping rule for site B to scrape the same novel, will the plugin know that the novel already exists and skip scraping from site B?

    • October 29, 2023 at 5:26 pm #8950


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Hello,

      First of all, thank you for your purchase.

      Wildcard usage is possible, only if you use it alone (*) – in this case, it will import all mangas from the site.

      Otherwise, I recommend you use keyword based searches (not URL searches).

      Example:

      naruto

      bleach

      night

      I hope this info helps.

      Regards, Szabi – CodeRevolution.

    • October 29, 2023 at 5:46 pm #8953


      Sankalan
      Participant
      Post count: 16

      Hello Szabi,

      Thanks for the reply. Using (*) alone is helping.

      I just need to know that will the plugin manage to identify the same webnovel on two different sites and pull the webnovel only once from one website?

    • October 29, 2023 at 6:02 pm #8954


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Yes, this will be covered.

    • October 29, 2023 at 6:04 pm #8955


      Sankalan
      Participant
      Post count: 16

      Excellent!

      Thank you so much!

    • October 30, 2023 at 2:42 am #8959


      Sankalan
      Participant
      Post count: 16
      This reply has been marked as private.

    • October 30, 2023 at 5:37 am #8960


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Hello,

      This issue can be caused by NodeJS and Puppeteer not being installed correctly on your server. Please follow this tutorial video to install them on your server: https://www.youtube.com/watch?v=pRUDcSOe724

      Let me know if this helped.

      Regards.

    • October 30, 2023 at 9:23 am #8961


      Sankalan
      Participant
      Post count: 16

      It did not help. I asked the server tech guys to install both NodeJS and Puppeteer. They installed NodeJS v.14 and also installed Puppeteer.

      The plugin is still throwing the same error and it is no longer updating any manga.

    • October 30, 2023 at 9:25 am #8962


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Hello,

      Can you send me, please, temporary admin login credentials to your WordPress install, so I can check this issue out? Send it, please, to my email address: kisded@yahoo.com

      Regards, Szabi – CodeRevolution

    • October 30, 2023 at 10:02 am #8963


      Sankalan
      Participant
      Post count: 16
      This reply has been marked as private.

    • October 30, 2023 at 11:32 am #8964


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      I replied by email, please check.

      Regards.

    • October 30, 2023 at 11:42 am #8965


      Sankalan
      Participant
      Post count: 16

      Thank you!

      I have contacted my hosting provider and waiting for their reply. I will let you know about the progress.

      Regards!

    • October 30, 2023 at 4:05 pm #8966


      Sankalan
      Participant
      Post count: 16
      This reply has been marked as private.

    • October 30, 2023 at 6:26 pm #8967


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Hello,

      Puppeteer is still not correctly installed, as the error reads in the middle of the message:

      Error: Could not find Chrome (ver. 118.0.5993.70). This can occur if either 1. you did not perform an installation before running the script (e.g. npm install) or 2. your cache path is incorrectly configured 

      This link might help: https://github.com/puppeteer/puppeteer/issues/10729

      Regards.

    • October 31, 2023 at 8:41 am #8968


      Sankalan
      Participant
      Post count: 16

      I shared the link with them and this is what they said:

      Hi,

      Sorry for the delay in getting back to you, I would say the github link you have provided is for docker and it will create seperate docker container for chromimum browser but your server is bare metal server. please share this details to your plugin support.

      Looks like it won’t be solved. Thanks, anyway!

    • October 31, 2023 at 9:09 am #8969


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      I am sorry to hear this. Maybe migrating your site to a new hosting provider or a VPS server might help.

      Regards.

  • Author
    Posts
Viewing 15 reply threads

The topic ‘Wildcard usage in Ultimate Web Novel and Manga Scraper’ is closed to new replies.