Blob

Hello Szabi,

I understand and I had seen the video about it, but as other scrappers do, I wanted to know if it was possible.

I’m not creating an additional topic, but if you’d like I can, as it’s a topic in its own right:

I’m scrapping a Shopify.
1. I’ve noticed a lot of image files being uploaded. But the problem lies in the variants. There are many duplicates for each variant.

1.1 There seems to be 1 image per variant. This seems logical, since a variant can be different, but in reality this is only true in certain cases.

So if I have 15 variants with the same image, for example for a T-shirt that comes in 15 different sizes, I have 15 images. 1 useful, 14 useless.

Isn’t it possible to detect if the image used is identical (same URL)?
If so, don’t download the image. This seems possible, as other scrappers do it.

I wish you all a Merry Christmas. Enjoy the time with your families.

Thank you very much.
Blob