Data, AI and orchestration · Acquisition and document processing

Scrapy

Licence or access: Open source, BSD-3-Clause

status license: Open source, BSD-3-Clause
best use: Crawling permitted public pages with throttling, caching, and item pipelines
boundary: Respect robots, terms, authentication, copyright, and rate limits
official source: Scrapy repository

Official sources

Scrapy repository https://github.com/scrapy/scrapy

Catalogued at the 2026-09-01 research baseline. Verify the licence, free-tier limits, API schema and source terms again before deployment, and record a version-pinned registry entry for whatever you select.

Source: file 09 · 2-acquisition-and-document-processing · line 26

More from this library GET /v1/tools/scrapy-4