The Scrapy tutorial part III: How To Scrape Data From Multiple Web Pages

Developed by Pablo Hoffman and Shane Evans, Scrapy is an open-source python framework built specifically for web data extraction. With Scrapy spiders, you are able to download HTML, parse and process the data and save it in either CSV, JSON, or XML file formats.

So far you've learned how to build a Scrapy spider to extract an item from a page. Now you will learn how to scrape multiple items from the same page.

After watching this, you will know:

• How to iterate over page elements
• How to extract data from repeating elements

If you haven't yet, we recommend you to first watch part I and part II of our tutorial series.

If you like what you saw, we can recommend you to also check out the links below:

• The Scrapy tutorial course part IV: How to follow pagination links
• The Scrapy tutorial course part V: How to srape details pages from lists
• Scrapy tutorial
• The 30 CSS selectors you must memorize
• Scrapy CLI tool commands