Explore resources by topic or category
Browse by Category
Blog
Selenium, Puppeteer, Playwright: Which tool is right for web scraping at scale?
Neha Setia Nagpal
1 mins
October 7, 2024
Discover the strengths and limitations of Selenium, Puppeteer, and Playwright for web scraping at scale.
Blog
4 essential Scrapy plugins for building efficient and effective spiders
Neha Setia Nagpal
1 mins
August 15, 2024
Blog
Scraping The Steam Game Store With Scrapy
Ian Kerins
13 Mins
July 7, 2017
This is a guest post from the folks over at Intoli, one of the awesome companies providing Scrapy commercial support and longtime Scrapy fans.
Blog
How to crawl the web with Scrapy
Valdir Stumm Junior
6 Mins
August 25, 2016
The first rule of web crawling is you do not harm the website. The second rule of web crawling is you do NOT harm the website. We’re supporters of the democratization of web data, but not at the expense of the website’s owners.
Blog
This Month In Open Source At Zyte August 2016
Marie Moynihan
2 Mins
August 4, 2016
Welcome to This Month in Open Source at Zyte! In this regular column, we share all the latest updates on our open source projects including Scrapy, Splash, Portia, and Frontera.
Blog
Meet Parsel: The Selector Library Behind Scrapy
Valdir Stumm Junior
3 Mins
July 28, 2016
We eat our own spider food since Scrapy is our go-to workhorse on a daily basis. However, there are certain situations where Scrapy can be overkill and that’s when we use Parsel.