Crawlomatic & Newsomatic – Duplicate content gets generated

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

Viewing 3 reply threads
  • Author
    Posts
    • #10150


      shandysuta
      Participant
      Post count: 11

      Hi Szabi,

      I am using Newsomatic (to get the top news) and Crawlomatic (to better manage the category).
      However, there’s a content already generated by crawlomatic, and handled with aiomatic, but then newsomatic also pulling it too, resulting double in post.

      How do I prevent this?

      Regards,
      Shandy

    • #10152


      Szabi – CodeRevolution
      Keymaster
      Post count: 4187

      Hello,

      If the titles are rewritten by Aiomatic, unfortunately there will be no clear way to check for duplicates of posts. The best option is to not rewrite titles and check the ‘Make Sure No Duplicate Post Titles Are Published’ checkbox from Crawlomatic’s ‘Main Settings’ menu.

      Regards, Szabi – CodeRevolution.

    • #10157


      shandysuta
      Participant
      Post count: 11

      I understand, thought so.

      However there’s this ‘source_url’ on the metadata of the post which points to the original source, do you think it could be a feature by looking and matching new crawl at the metadata so it’s not duplicating it if they have the same source_url?

       

      Might be a good addition for the ecosystem of the plugin!

    • #10158


      Szabi – CodeRevolution
      Keymaster
      Post count: 4187

      Idea noted, will think on this.

      Regards.

Viewing 3 reply threads

The topic ‘Crawlomatic & Newsomatic – Duplicate content gets generated’ is closed to new replies.