Site icon CodeRevolution Support

Duplicate posts with same source and title

Hello, Thank you again for creating such a wonderful plugin.  There is one item that I was hoping you could help me with. I have created rules that scrape news websites for keywords from their RSS feeds.  Some of the RSS feeds are updated automatically by the source sites.  For others, I have asked the source site to convert its search query into an RSS feed. The sites that I am scraping based on the search query -> RSS are returning duplicates.  By narrowing down my required words, I can get the results pretty close to what I want.  For the results that are undesirable, I manually move them into a category called Do Not Post and hide that category from the front-end.  I am finding that the rule will make a duplicate post with the same article title.  The slug for the post will append -1 or -2.  I have seen this number increment each time the rule is run. An example rule that will always create duplicates is: https://www.cbs46.com/search/?f=html&q=voting+georgia&s=start_time&sd=desc&l=25&t=article%2Cvideo%2Cyoutube&nsa=eedition&f=rss Duplicates are created with "Check Duplicate Posts By Title Instead of Source URL:" enabled and disabled. Can you help me determine why duplicates are being created?  Thank you.  
Exit mobile version