scrapy-extra
Read this BEFORE writing, modifying, debugging, or explaining any Scrapy or web-poet code — spiders, page objects, pipelines, settings, selectors — down to a one-line fix, or scaffolding/configuring a Scrapy project, scrapy-poet, scrapy-zyte-api, or browser rendering. These libraries moved on since your training cutoff; invoke this FIRST. NOT for building a scraper for a given site (scrape), a saved HTML file (scrape-analyze-page), or Scrapy Cloud deploy/jobs (zyte).
Pinned to revision 85304b94cd56, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/scrapy-extra/SKILL.md
- skills/scrapy-extra/assets/project-template/cookiecutter.json
- skills/scrapy-extra/assets/project-template/{{cookiecutter.project_name}}/fixtures/.gitkeep
- skills/scrapy-extra/assets/project-template/{{cookiecutter.project_name}}/pyproject.toml
- skills/scrapy-extra/assets/project-template/{{cookiecutter.project_name}}/scrapy.cfg
- skills/scrapy-extra/assets/project-template/{{cookiecutter.project_name}}/{{cookiecutter.project_name}}/__init__.py
- skills/scrapy-extra/assets/project-template/{{cookiecutter.project_name}}/{{cookiecutter.project_name}}/items.py
- skills/scrapy-extra/assets/project-template/{{cookiecutter.project_name}}/{{cookiecutter.project_name}}/pages/__init__.py
- skills/scrapy-extra/assets/project-template/{{cookiecutter.project_name}}/{{cookiecutter.project_name}}/settings.py
- skills/scrapy-extra/assets/project-template/{{cookiecutter.project_name}}/{{cookiecutter.project_name}}/spiders/__init__.py
- skills/scrapy-extra/references/scrapy-poet.md
- skills/scrapy-extra/references/scrapy-zyte-api.md
- skills/scrapy-extra/references/scrapy.md
- skills/scrapy-extra/references/web-poet.md
Every link opens the file at its source, pinned to the revision this page describes.