Site icon CodeRevolution Support

Remembering last link crawled in TXT file

Hello, I am testing out the feature to crawl a TXT file. I have a huge list of links set up to crawl for updating data. I set the rule active to test only 10 posts per hour. The rule works as expected, but every time the rule runs, it starts over from the first link in the list. I have set 'Remember Last Paged URL' on, but it doesn't start where it left off. Any suggestions?
Exit mobile version