Command-line tool

scrapy

brew/scrapy

Checked 25 Oct 2026, 21:09 UTC · Listing refreshed from Homebrew, winget, npm, Scoop and cargo; npm packages checked against OSV.dev

Web crawling & scraping framework

Website Source

At a glance

Type

Command-line tool

Install on

Windows, macOS, Linux

Last checked

25 Oct 2026, 21:09 UTC

Install it

Windows

pipx install scrapy

macOS

brew install scrapy
pipx install scrapy

Linux

brew install scrapy
pipx install scrapy

Create a project

scrapy startproject project_name

Create a spider (in project directory)

scrapy genspider spider_name website_domain

Edit spider (in project directory)

scrapy edit spider_name

Browse

• Web scraping
• Website monitoring

Related command-line tools

• trafilatura
  Discovery, extraction and processing for Web text
• katana
  Crawling and spidering framework markdown mermaid plantuml linux-amd64 mados windows-amd64
• framework_tool
  framework_tool (Windows package; no description in the winget index)
• framework-tool-tui
  TUI for controlling and monitoring Framework Computers hardware
• rogue
  Dungeon crawling video game
• mcp-framework
  Framework for building Model Context Protocol (MCP) servers in Typescript mcp claude anthropic ai framework tools…
• certgraph
  Crawl the graph of certificate Alternate Names
• robot-framework
  Open source test framework for acceptance testing

Listing text is written by the maker; AptLynx lists tools and does not vouch for them. Find another tool · Browse by topic · For agents