Explore resources by topic or category

In 2020, Quibi entered the streaming market with high hopes. They wanted to offer a unique service and capture a market share of the booming industry. But the company didn't conduct extensive product intelligence research.

cURL stands for "Client URL", it is an open-source command-line tool that allows users to transfer data to or from a web server using various network protocols such as HTTP, HTTPS, FTP, and more. By providing a command line interface, it enables users to collect data from websites with ease. It is widely used for tasks such as API interaction and remote file downloading or uploading.

Flipping a coin, going with your gut, closing your eyes and begging the universe for guidance on how to proceed — these all have their place, sure. But using data to make decisions is a far more reliable approach in business.

Imagine a long crawling process, like extracting data from a website for a whole month. We can start it and leave it running until we get the results.

I recently had the pleasure of participating in the third episode of Graphversation, a monthly live stream series that brings together graph experts and Neo4j enthusiasts for engaging and enlightening discussions about the captivating world of graphs.

HTML tables are a very common format for displaying information. When building scrapers you often need to extract data from HTML tables on web pages and turn it into some different structured format, for example, JSON, CSV, or Excel. In this article, we discuss how to extract data from HTML tables using Python and Scrapy.

Web crawlers are becoming increasingly popular in the era of big data, especially now with the advent of Large Language Models (LLMs) such as ChatGPT and LLaMA. The sheer amount of data that is publicly available from the web has a wide variety of applications including market research, sentiment analysis, and predictive modeling.

Today we’re excited to announce to the Zyte and Web Scraping communities our new offering: Zyte API Enterprise.

Whether you're trying to analyze market trends or gather data for research, web scraping can be a useful skill to have. This technique allows you to extract specific pieces of data from websites automatically and process them for further analysis or use.

Data extraction from news sites and social media platforms is becoming an increasingly common practice. Popular use cases range from ensuring more informed investment decisions to protecting brand reputation.

Our vision was to create a single API that takes care of all your web data extraction needs. So we built a web scraping infrastructure that can handle the most demanding use cases for the most sophisticated users.