Explore resources by topic or category

If you’re not using AI, you’re being left behind. Ever since ChatGPT burst onto the scene, this is the message developers are constantly hearing.

In the second part of our in-depth interview with Voy Zeglin, we delve into the nitty-gritty of web scraping. Voy shares his expertise on how his company, Data Miners, deals with anti-scraping measures and maintains high data quality.

In this article, I’llexplain the problem of anti-bot technology for web scraping developers through the lens of the anti-bot distribution curve (a view of the top 250,000 websites and the relative complexity of their anti-bot tech) and the landscape of anti-bot tech across the web.

Zyte’s flagship product, Zyte API, now includes built-in features that automate crawling using spider templates, and our patented AI-powered automated extraction, which gives you quality structured data quickly without writing custom parsing code.

Data mining and web scraping – sounds like two buzzwords meaning the same thing. Quite often data mining is misunderstood as the process of obtaining information from a website;

In this article we discuss some main challenges that e-commerce retailers face on a daily basis due to the amount of web data needed and how to solve them.

In 2023, Meta sued Bright Data for scraping data from Facebook and Instagram, alleging that its scraping breached Facebook and Instagram’s terms of service and is thus a breach of contract.

The reputation of web scraping hasn’t always been the best. Unsavory actors have cast a shadow over the reputable parts of the web scraping industry at large, and it has to stop.