Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.
This topic has 9 replies, 2 voices, and was last updated 1 year, 5 months ago by Szabi – CodeRevolution.
-
AuthorPosts
-
-
July 20, 2023 at 10:35 am #8121
Hello,
I have purchased your plugin to crawl 2 websites for Last minute travel.
The pages that I have to crawl use Javascript, so I have therefore also purchased a subscription to HeadlessBrowserAPI.
Now I have spent 2 days trying to get Crawlomatic to work without success..
The website itself uses cookies, which I have set to accept when crawling. This works fine, except that it takes 2 minutes for the “Visible Selector” to load the page.But then my Crawl reports an error every time I run it?
Is it something you want to look at, what I’m doing wrong?
Another important thing is that I hoped to be able to crawl various things from the final website, such as:
Travel destination
Price
trip durationAnd then insert data into various custom posts. Is this even possible with your plugin?
My website:
https://findafbudsrejse.dk/wp-admin
Username: <REDACTED>
Password: <REDACTED>I am trying to Crawl:
https://www.aarhuscharter.dk/afbudsrejserMany Thanks!
Lars
- This topic was modified 1 year, 5 months ago by Szabi - CodeRevolution.
Attachments:
You must be logged in to view attached files. -
July 20, 2023 at 12:11 pm #8124
This reply has been marked as private. -
July 20, 2023 at 1:47 pm #8125
Thank you so much Szabi!
Can you please tell me – Is it possible to insert the crawled data into diffrent custom meta fields?
I have created a Custom Post type with Jetengine, where i would like to insert the data in 6 diffrent fields.
Best Regards
Lars
-
July 20, 2023 at 2:19 pm #8126
Yes, this is possible. You need to use the ‘Custom Shortcode Creator’ feature of the plugin, to extract specific parts of scraped data. Tutorial video for this: https://www.youtube.com/watch?v=OnANHg0OSVw
The shortcodes you create like this, ca be used in the ‘Post Custom Fields’ settings field, to assign them to custom fields in posts. Tutorial video: https://www.youtube.com/watch?v=GMIojmlI9fA
Regards.
-
July 20, 2023 at 2:48 pm #8127
Thank you so much!! That was an exceptional service!
I will definitely buy some more plugins from you guys!
-
July 20, 2023 at 2:59 pm #8128
I also thank you!
Regards.
-
July 21, 2023 at 2:06 pm #8134
This reply has been marked as private. -
July 21, 2023 at 2:51 pm #8136
Hello,
I am sorry, but currently extracting information from the seed page is not possible. However, I noted this idea, will think on this for upcoming plugin updates.
Regards, Szabi – CodeRevolution.
-
July 21, 2023 at 8:06 pm #8141
Hello,
Okay.
I have 8 span classes at the crawled site with prices. When i crawl by “price class” i import 8 prices.
Is it possible to limit it to one price only?BR Lars
-
July 21, 2023 at 8:10 pm #8142
Please send me the URL of the page you are scraping in private to my email kisded@yahoo.com and I check on this.
Please include also some screenshots of your current plugin settings, so I know what to check and from where to extract the price from the page. Include also screenshots with the price you want to extract, from the scraped page.
Regards.
-
-
AuthorPosts
The topic ‘Store data in Custom posts’ is closed to new replies.