Store data in Custom posts

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

Viewing 9 reply threads
  • Author
    Posts

    • July 20, 2023 at 10:35 am #8121


      LSM42
      Participant
      Post count: 4

      Hello,

      I have purchased your plugin to crawl 2 websites for Last minute travel.

      The pages that I have to crawl use Javascript, so I have therefore also purchased a subscription to HeadlessBrowserAPI.

      Now I have spent 2 days trying to get Crawlomatic to work without success..
      The website itself uses cookies, which I have set to accept when crawling. This works fine, except that it takes 2 minutes for the “Visible Selector” to load the page.

      But then my Crawl reports an error every time I run it?

      Is it something you want to look at, what I’m doing wrong?

      Another important thing is that I hoped to be able to crawl various things from the final website, such as:
      Travel destination
      Price
      trip duration

      And then insert data into various custom posts. Is this even possible with your plugin?

      My website:
      https://findafbudsrejse.dk/wp-admin
      Username: <REDACTED>
      Password: <REDACTED>

      I am trying to Crawl:
      https://www.aarhuscharter.dk/afbudsrejser

      Many Thanks!

      Lars

      Attachments:
      You must be logged in to view attached files.

    • July 20, 2023 at 12:11 pm #8124


      Szabi – CodeRevolution
      Keymaster
      Post count: 4192
      This reply has been marked as private.

    • July 20, 2023 at 1:47 pm #8125


      LSM42
      Participant
      Post count: 4

      Thank you so much Szabi!

      Can you please tell me – Is it possible to insert the crawled data into diffrent custom meta fields?

      I have created a Custom Post type with Jetengine, where i would like to insert the data in 6 diffrent fields.

      Best Regards

      Lars

    • July 20, 2023 at 2:19 pm #8126


      Szabi – CodeRevolution
      Keymaster
      Post count: 4192

      Yes, this is possible. You need to use the ‘Custom Shortcode Creator’ feature of the plugin, to extract specific parts of scraped data. Tutorial video for this: https://www.youtube.com/watch?v=OnANHg0OSVw

      The shortcodes you create like this, ca be used in the ‘Post Custom Fields’ settings field, to assign them to custom fields in posts. Tutorial video: https://www.youtube.com/watch?v=GMIojmlI9fA

      Regards.

    • July 20, 2023 at 2:48 pm #8127


      LSM42
      Participant
      Post count: 4

      Thank you so much!! That was an exceptional service!

      I will definitely buy some more plugins from you guys!

    • July 20, 2023 at 2:59 pm #8128


      Szabi – CodeRevolution
      Keymaster
      Post count: 4192

      I also thank you!

      Regards.

    • July 21, 2023 at 2:06 pm #8134


      LSM42
      Participant
      Post count: 4
      This reply has been marked as private.

    • July 21, 2023 at 2:51 pm #8136


      Szabi – CodeRevolution
      Keymaster
      Post count: 4192

      Hello,

      I am sorry, but currently extracting information from the seed page is not possible. However, I noted this idea, will think on this for upcoming plugin updates.

      Regards, Szabi – CodeRevolution.

    • July 21, 2023 at 8:06 pm #8141


      LSM42
      Participant
      Post count: 4

      Hello,

      Okay.
      I have 8 span classes at the crawled site with prices. When i crawl by “price class” i import 8 prices.
      Is it possible to limit it to one price only?

      BR Lars

    • July 21, 2023 at 8:10 pm #8142


      Szabi – CodeRevolution
      Keymaster
      Post count: 4192

      Please send me the URL of the page you are scraping in private to my email [email protected] and I check on this.

      Please include also some screenshots of your current plugin settings, so I know what to check and from where to extract the price from the page. Include also screenshots with the price you want to extract, from the scraped page.

      Regards.

  • Author
    Posts
Viewing 9 reply threads

The topic ‘Store data in Custom posts’ is closed to new replies.