Monitor Competitor metrics

Now, I would like to show you a use case on Pyspider, and also tell you the cool features of Pyspider, but if you want me to introduce Pyspider, please leave a comment below and I will write a post to introduce you the framework and its key concepts.

I will be more focusing on Pyspider instead of going into every detail on the web scraping part. If you are more interested in learning web scraping, do visit my series of Get Rid of BORING stuff using Python for step by step explanation.

Let’s get started!

Similarweb — an online competitive intelligence tool that provides traffic and marketing insights for any website. I will be showing you how to scrape this website by leveraging the power of Puppeteer.