Duplicate posts with same source and title
Hello,
Thank you again for creating such a wonderful plugin. There is one item that I was hoping you could help me with.
I have created rules that scrape news websites for keywords from their RSS feeds. Some of the RSS feeds are updated automatically by the source sites. For others, I have asked the source site to convert its search query into an RSS feed.
The sites that I am scraping based on the search query -> RSS are returning duplicates. By narrowing down my required words, I can get the results pretty close to what I want. For the results that are undesirable, I manually move them into a category called Do Not Post and hide that category from the front-end. I am finding that the rule will make a duplicate post with the same article title. The slug for the post will append -1 or -2. I have seen this number increment each time the rule is run.
An example rule that will always create duplicates is:
https://www.cbs46.com/search/?f=html&q=voting+georgia&s=start_time&sd=desc&l=25&t=article%2Cvideo%2Cyoutube&nsa=eedition&f=rss
Duplicates are created with "Check Duplicate Posts By Title Instead of Source URL:" enabled and disabled.
Can you help me determine why duplicates are being created? Thank you.