WARNING: images used in the content of brightside.me are copyrighted and are illegal to be copied. This video is only for demonstration purposes.
This is an advanced tutorial showing how to scrape JavaScript rendered content using the Crawlomatic plugin and HeadlessBrowserAPI.
🔎 RESOURCES MENTIONED 👇
Crawlomatic ► https://1.envato.market/crawlomatic
HeadlessBrowserAPI ► https://headlessbrowserapi.com/
🤔 Settings I used in the Crawlomatic plugin for correct scraping 👇
FOR SINGLE SCRAPING:
Scraper Start (Seed) URL: https://brightside.me/inspiration-health/10-daily-habits-that-can-make-deodorant-less-effective-802066/
Content Scraping Method To Use: Puppeteer (HeadlessBrowserAPI)
Headless Browser Wait Before Rendering Pages (ms): 5000
Strip HTML Elements by Tag Name: svg
Content Query Type: XPath/CSS Selector
Content Query String: //*[@data-test-id=’article-content’]
Strip HTML Elements by XPATH/CSS Selector: //*[@data-adunit-started=’true’]
FOR SERIAL SCRAPING:
Scraper Start (Seed) URL: https://brightside.me/
Do Not Scrape Seed URL: checked
Seed Page Crawling Query Type: XPath/CSS Selector
Seed Page Crawling Query String: //*[@data-test-id=’title-link’]
Content Scraping Method To Use: Puppeteer (HeadlessBrowserAPI)
Headless Browser Wait Before Rendering Pages (ms): 5000
Strip HTML Elements by Tag Name: svg
Content Query Type: XPath/CSS Selector
Content Query String: //*[@data-test-id=’article-content’]
Reverse Crawling Order: checked
Skip Scraping Post If Below Content Query Is Not Found: Checked
Strip HTML Elements by XPATH/CSS Selector: //*[@data-adunit-started=’true’]
💥 Join this channel to get access to member only videos and PERKS 👇
https://www.youtube.com/channel/UCVLIksvzyk-D_oEdHab2Lgg/join
💥 Join my FREE newsletter to discover my insights (and also to get the YouTube Caption Scraper plugin for FREE) 👇
https://coderevolution.mailchimpsites.com/
💻 MY WORDPRESS PLUGINS 👇
https://1.envato.market/coderevolutionplugins
▶[SPECIAL OFFER] GET ALL MY PLUGINS AT ONCE! – https://1.envato.market/bundle
💻 MY COURSES 👇
https://coderevolution.teachable.com/
👍🏼 Please help & give the video a like if you enjoyed it!
❤️ Not Yet Subscribed? https://www.youtube.com/channel/UCVLIksvzyk-D_oEdHab2Lgg?sub_confirmation=1
▶ Check my Community of WordPress Experts by Joining CodeRevolution’s Facebook Group 👉🏼 https://www.facebook.com/groups/coderevo/
🔔 Hit the notification bell to ensure you get notified!
✅ CAN I HELP YOU OR YOUR BUSINESS ❓
🌍 Become a member of my website today, to enjoy premium tutorials: https://coderevolution.ro/join-the-site/
✅ EITHER WAY, CAN WE KEEP IN TOUCH ❓
🔗 Join the CodeRevolution VIP List here 👉🏼 https://coderevolution.mailchimpsites.com/
🗣️ TALK TO ME AND FOLLOW CODEREVOLUTION 💥 ON SOCIAL MEDIA 👇
Instagram ► https://www.instagram.com/coderevolution_envato/
Facebook ► https://www.facebook.com/CodeRevolution.envato/
Twitter ► https://twitter.com/code2revolution
LinkedIn ► https://www.linkedin.com/company/18002194
Pinterest ► https://pinterest.com/caddy_lagaristu/coderevolution/
🤔 ABOUT CODEREVOLUTION TV 😃
Hello, I’m Szabi, a 32 years old guy living with my wife and our beautiful 4 year old daughter Maya. I started my journey in WordPress plugin development back in 2017, when I quit my programmer job and became a full time stay at home WordPress plugin developer, entrepreneur, blogger and also daddy. Since then, I implemented over 100 WordPress plugins, earning my full time income from them.
I started this YouTube channel to share tutorials for my plugins with people who are using them, however, since then, the channel has evolved into a daily VLOG, besides of tutorials for my plugins, I am sharing here also my insights about how to be a successful entrepreneur in our current times.
On this YouTube channel, I publish new videos regularly (each time I have to tell you about something new)! If you don’t want to miss my videos, subscribe and hit the bell notification also!
📚 RECOMMENDED RESOURCES 👇
See what services I use to power my business online and help me earn as an affiliate
https://coderevolution.ro/recommendations/
Do you want to start autoblogging? Check my recommended resources below 👇
https://coderevolution.ro/more-automation/
▶ GEAR I USE IN MY VIDEOS 👇
Microphone: Trust GXT 252+ Emita Plus Streaming Microphone:
https://amzn.to/2LB79sv
Web Cam: Logitech Brio 4K Stream Edition: https://amzn.to/2N5CNid
To your success,
Szabi – CodeRevolution.
DISCLAIMER: The information contained on this YouTube Channel and the resources available for download/viewing through this YouTube Channel are for educational and informational purposes only.
This description may contain affiliate links. If you purchase a product through one of them, I will receive a commission (at no additional cost to you). I only ever endorse products that I have personally used and benefited from personally. Thank you for your support!
#CRAWLOMATIC #HEADLESSBROWSERAPI #SCRAPING #CRAWLING