Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.
This topic has 5 replies, 2 voices, and was last updated 2 years ago by Szabi – CodeRevolution.
-
AuthorPosts
-
-
November 2, 2022 at 1:06 pm #6223
Hello! I would like to fix this problem please:
In MaxPosts of every rule I’ve selected to create 50 post every time this rule runs. But is not getting exactly that number.
Whys is that? Maybe it has any time period for to get posts from the past? I mean, maybe the rule gets from the last 12 hours something like this?
The pother problem is the rules are not running every hour as i’ve marked, althoug Ive changed as you soggest, from Wp Cron to real Cron running from cron-job.org and working perfectly every 10 minutes.
Any suggestion?
Attachments:
You must be logged in to view attached files. -
November 2, 2022 at 3:20 pm #6226
Hello,
First of all, thank you for your purchase.
I checked the RSS feed from where you are importing posts (https://www.telam.com.ar/rss2/sociedad.xml) and I see that it contains 20 feed items in it. This means that the plugin will be able to import from this RSS feed at any given time a maximum of 20 posts. However, the posts which will be published in the future on this site, will also be added to this RSS feed and they will be automatically imported by the plugin.
If you want to scrape also older posts from this site, I recommend you check also the Crawlomatic plugin I created, which uses direct web scraping and can get also older posts from sites: https://1.envato.market/crawlomatic
Regarding the cron functionality, I suspect that it works for you correctly, however, as posts are imported only when the feed is updated, the plugin will be able to pull in new posts by a schedule only when the RSS feed is updated with new posts – because of this, the schedule might not import anything as expected, but only when the source website publishes new content in its RSS feeds (as the plugin will not publish duplicate posts – will skip the posts which it already published on your site).
Let me know if this info helped.
Regards, Szabi – CodeRevolution.
-
November 4, 2022 at 3:10 am #6228
This reply has been marked as private. -
November 4, 2022 at 5:46 am #6229
Hello,
I am glad to hear that it works.
Tweets and videos are content which is JavaScript generated, which makes their importing possible only if you use a headless browser to render the content before scraping it in the plugin (as only headless browsers are able to render also JavaScript in the scraped content – to generate the dynamic content).
This is possible in the plugin if you install on your server Puppeteer (which is a headless browser). Please check this tutorial video on how to install Puppeteer on your server: https://www.youtube.com/watch?v=KNOIJA4pTQo – afterwards, you can set up the plugin to use Puppeteer for scraping, as shown in this video: https://www.youtube.com/watch?v=g99IlDkt_SY
If this is not possible on your server, the plugin supports also HeadlessBrowserAPI, which is a cloud based service which renders pages in Puppeteer and returns the full HTML content for them, please check details here: https://www.youtube.com/watch?v=205EinBQAoo&list=PLEiGTaa0iBIjDrfexapWc3M28iHwJI5tT&index=2 + website: https://headlessbrowserapi.com/
Regards, Szabi – CodeRevolution.
-
November 9, 2022 at 2:08 am #6241
There is a way of download the logs?
-
November 9, 2022 at 5:38 am #6242
Currently downloading logs is not possible, but i noted your idea.
Regards.
-
-
AuthorPosts
The topic ‘Not getting the exact post selected in settings’ is closed to new replies.