Back to RepoInsider
Signal dossier

garagehq/nightcrawler

Data Processing

Pulse

0

Velocity

Stars

0

A distributed web crawler and data extraction framework.

Efficiently scrapes and extracts data from websites at scale.

Harvests vast amounts of web data using distributed, resilient crawling.

Why Trending

Provides robust, scalable web scraping capabilities for large datasets.

Target Audience

Data scientists and developers needing web data.

Similar Projects

ScrapyPlaywright (for scraping)Beautiful Soup
RepoInsider · Spot breakout GitHub repos early