Site icon CodeRevolution Support

Crawling problem

<div class="_4xko _4xks" tabindex="0" role="button">I have trouble setting up the Crawlomatic plugin. I want the plugin to crawl only the first 3 articles from this page: https://www.kromannreumert.com/Nyheder. I am using headlessbrowserAPI to get the content. I have set the "Maximum Crawl Results to Get" to 3, but when I look in the log, it looks like it keeps crawling all the news articles from the seed page every single day, which means that I run out of API calls all the time. Can you help me with my problem?</div>
Exit mobile version