📝 Edit page ➕ Add page

Scrapy

Scrapy is an open-source and collaborative web crawling framework for Python. It's designed for extracting structured data from websites, which can be used for a wide range of applications like data mining, information processing, or historical archival.

Resources / Python / Libraries / Web scraping / Scrapy

Byline:

A Fast and Powerful Scraping and Web Crawling Framework

Wikipedia excerpt:

Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It is currently maintained by Zyte (formerly Scrapinghub), a web-scraping development and services company.

Key links

🏠 Homepage: https://scrapy.org/
📗 Docs: https://docs.scrapy.org/
📓 Wiki: https://github.com/scrapy/scrapy/wiki
👨‍💻 Repo:
📦 Package URL: https://pypi.org/project/Scrapy/
🌐 Wikipedia

Documentation

Scrapy Tutorial
- A comprehensive tutorial to get you started with Scrapy.
Scrapy at a glance
- An overview of Scrapy’s main concepts and architecture.

Tutorials

Scrapy Tutorial for Beginners
- A YouTube playlist by Build With Python, offering a step-by-step introduction to Scrapy.
Scrapy Course – Python Web Scraping for Beginners
- A comprehensive YouTube course by Coding Is Fun, covering Scrapy from basics to advanced topics.