Crawling a page with infinite scroll
Hi, just a quick question - is the Crawlomatic plugin able to scrape a page with infinite scrolling? I was doing some testing and got stuck on a page with infinite scroll. I did try setting '<b>Seed Page Pagination Query Type</b>' to '<b>auto detect</b>'. But it ends up trying to read other content on the page, in the footer. Just wondering if I missed a certain setting that might make it possible to continue scrolling.