Crawlomatic & Newsomatic – Duplicate content gets generated

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

This topic has 3 replies, 2 voices, and was last updated 9 months, 1 week ago by Szabi – CodeRevolution.

Viewing 3 reply threads
  • Author
    Posts

    • March 15, 2024 at 2:47 pm #10150


      shandysuta
      Participant
      Post count: 11

      Hi Szabi,

      I am using Newsomatic (to get the top news) and Crawlomatic (to better manage the category).
      However, there’s a content already generated by crawlomatic, and handled with aiomatic, but then newsomatic also pulling it too, resulting double in post.

      How do I prevent this?

      Regards,
      Shandy

    • March 15, 2024 at 3:23 pm #10152


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Hello,

      If the titles are rewritten by Aiomatic, unfortunately there will be no clear way to check for duplicates of posts. The best option is to not rewrite titles and check the ‘Make Sure No Duplicate Post Titles Are Published’ checkbox from Crawlomatic’s ‘Main Settings’ menu.

      Regards, Szabi – CodeRevolution.

    • March 15, 2024 at 5:55 pm #10157


      shandysuta
      Participant
      Post count: 11

      I understand, thought so.

      However there’s this ‘source_url’ on the metadata of the post which points to the original source, do you think it could be a feature by looking and matching new crawl at the metadata so it’s not duplicating it if they have the same source_url?

       

      Might be a good addition for the ecosystem of the plugin!

    • March 15, 2024 at 7:08 pm #10158


      Szabi – CodeRevolution
      Keymaster
      Post count: 4620

      Idea noted, will think on this.

      Regards.

  • Author
    Posts
Viewing 3 reply threads

The topic ‘Crawlomatic & Newsomatic – Duplicate content gets generated’ is closed to new replies.