Questions About Tartarus

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

This topic has 6 replies, 2 voices, and was last updated 2 years, 7 months ago by Szabi – CodeRevolution.

Viewing 6 reply threads
  • Author
    Posts

    • May 3, 2022 at 8:19 pm #5078


      NBERIOZKIN0616
      Participant
      Post count: 13

      Hi Szabi,

      I’m thinking about purchasing your Tartarus plugin. I just have a couple of quick questions:

      1. In the allowed bots section, do we need to add Facebook bot, Pinterest, Linkedin, Twitter, etc? I am planning on promoting and running ads via those social networks for my site; do those networks not send bots to verify the pages? If so, do you have a full list of such exceptions I can paste into the “allowed bots” field.

      2. Will this plugin still work if I put my site on Cloudflare?

      3. My main hope for this plugin is to prevent DMCA and other image copyright seeking bots from crawling the site – is this a practical application of this plugin? Are there specific bots I should block that are not part of your default list?

       

      Many thanks!

    • May 4, 2022 at 6:01 am #5079


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Hello,

      Thank you for contacting me.

      1. The plugin will come with a list of good bots which are excepted from filtering. The list is as follows:

      googlebot,googleweblight,bingbot,mediapartners-google,ia_archiver,FeedFetcher-Google,msnbot,yandexbot,baiduspider,wordpress,apis-google,AdsBot-Google-Mobile,Google-Read-Aloud,DuplexWeb-Google,Storebot-Google,Googlebot-Image,AdsBot-Google-Mobile-Apps,Googlebot-Video,Googlebot-News,AdsBot-Google,facebot,facebookexternalhit,pinterest,twitter

      2. Yes, the plugin is working with CloudFlare.

      3. Well, the plugin also has a list of ‘Bad Bots’ it is able to ban out of the box. If you wish, I can provide also a list of bad bots which are currently blocked, in private. You can also add a list of user agents of bots you wish to ban, however, I am not sure if the DMCA bots will have a specific user agent which identifies them, I checked this on the net and did not found any useful info on this. If you manage to find a way to find out the user agents of these bots, they can be added in the exclusion list of the plugin and it will be able to block them.

      Regards, Szabi – CodeRevolution.

    • May 4, 2022 at 1:35 pm #5080


      NBERIOZKIN0616
      Participant
      Post count: 13
      This reply has been marked as private.

    • May 4, 2022 at 1:37 pm #5081


      NBERIOZKIN0616
      Participant
      Post count: 13
      This reply has been marked as private.

    • May 4, 2022 at 1:52 pm #5082


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620
      This reply has been marked as private.

    • May 4, 2022 at 2:27 pm #5083


      NBERIOZKIN0616
      Participant
      Post count: 13

      Perfect. Thanks so much!

    • May 4, 2022 at 3:23 pm #5084


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Glad to help!

  • Author
    Posts
Viewing 6 reply threads

The topic ‘Questions About Tartarus’ is closed to new replies.