Improving variant scrapping

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

This topic has 2 replies, 2 voices, and was last updated 4 hours, 18 minutes ago by Blob.

Viewing 2 reply threads
  • Author
    Posts

    • December 24, 2024 at 11:26 am #11511


      Blob
      Participant
      Post count: 1

      Hello,

      Thank you for this perfectly functional scrapper for my needs.
      However, I have a question about variants.
      The variant data is returned in this format and is only the value of each variant:
      $variant1 / $variant2 / $variant3
      This is obviously an example.

      Is it possible to obtain the variant type for each value?
      Example:
      Color:
      $variant

      Length :
      $variant

      I’ve added an image to show that the information is available for Shopify, for example. Is it therefore possible to obtain this information so that everything is presented correctly without reworking the data, which is a very important time-saver?

      Thank you very much.
      Blob

      Attachments:
      You must be logged in to view attached files.

    • December 24, 2024 at 12:13 pm #11513


      Szabi – CodeRevolution
      Keymaster
      Post count: 4623

      Hello,

      First of all, thank you for your purchase.

      Unfortunately, scraping separate variants is not possible in this case, as the data in the site structure of Shopify is represented in the ‘$variant1 / $variant2 / $variant3’ structure, not in the ‘Color: $variant Length : $variant’ structure. Because of this, the variants are imported in the plugin as a single entity.

      I noted this suggestion, will think on it, however, I already been hit by this issue when I created the plugin and back them I concluded that scraping separate variant data would make the implementation of the plugin exponentially more complicated. But I check on this again, will give it a second thought.

      Regards,
      Szabi – CodeRevolution.

    • December 24, 2024 at 8:43 pm #11514


      Blob
      Participant
      Post count: 1

      Hello Szabi,

      I understand and I had seen the video about it, but as other scrappers do, I wanted to know if it was possible.

      I’m not creating an additional topic, but if you’d like I can, as it’s a topic in its own right:

      I’m scrapping a Shopify.
      1. I’ve noticed a lot of image files being uploaded. But the problem lies in the variants. There are many duplicates for each variant.

      1.1 There seems to be 1 image per variant. This seems logical, since a variant can be different, but in reality this is only true in certain cases.

      So if I have 15 variants with the same image, for example for a T-shirt that comes in 15 different sizes, I have 15 images. 1 useful, 14 useless.

      Isn’t it possible to detect if the image used is identical (same URL)?
      If so, don’t download the image. This seems possible, as other scrappers do it.

      I wish you all a Merry Christmas. Enjoy the time with your families.

      Thank you very much.
      Blob

  • Author
    Posts
Viewing 2 reply threads

You must be logged in to reply to this topic.