Marketing, demand and conversion · Crawling, extraction and content velocity
Scrapy
Licence or access: BSD-3-Clause
- license
- BSD-3-Clause
- role and outputs
- custom spiders → JSON/JSONL/CSV/XML/local/object storage
- limitation
- generic, no JS/SEO rules by default; permission required
- official source
- Repo
Official sources
- Repo https://github.com/scrapy/scrapy
Catalogued at the 2026-09-01 research baseline. Verify the licence, free-tier limits, API schema and source terms again before deployment, and record a version-pinned registry entry for whatever you select.
Source: file 07 · 3-crawling-extraction-and-content-velocity · line 37