Weave Code
Crawler Laravel Package
spatie/crawler
Fast, concurrent web crawler for PHP. Crawl sites, collect internal URLs with depth limits, and hook into crawl events. Can execute JavaScript via Chrome/Puppeteer for rendered pages. Includes fakes for testing crawl logic without real HTTP requests.
|
Package
|
Description
|
Stars
|
Likes
|
Forks
|
Downloads
|
Issues
|
Score
|
Opportunity
|
License
|
Last Release
|
|
|---|---|---|---|---|---|---|---|---|---|---|---|
| spatie/http-status-check | CLI tool to crawl a website and report HTTP status codes for every link. Scan internal and optionally external URLs, control concurrency for speed, and export failing (non-2xx/3xx) links to a file for quick auditing. | 598 | 601 | 87 | 68 | 0 | 16.1 | 0.8 | MIT | 2 years ago | |
| spatie/laravel-export | Export a Laravel app as a static site bundle. Crawls your routes to generate HTML for every URL and copies your public assets into an export folder, ready to upload to Netlify or any static host—keep Laravel tools locally while deploying static. | 659 | 659 | 62 | 5K | 0 | 32.2 | 14.8 | MIT | 1 month ago | |
| spatie/laravel-link-checker | Unmaintained: Artisan command to crawl your Laravel app and check internal/external links. Logs URLs that don’t return 2xx/3xx responses and can email broken-link reports. Configurable base URL, link-check profiles, reporters, and concurrency settings. | 261 | 258 | 42 | 22 | 0 | 14.9 | 0.6 | MIT | 3 years ago | |
| spatie/laravel-site-search | Crawl and index your Laravel site for fast full-text search—like a private Google. Highly customizable crawling and indexing, with concurrent requests. Uses SQLite FTS5 by default (no external services), or Meilisearch for advanced features. | 306 | 308 | 24 | 3K | 0 | 31.3 | 15.8 | MIT | 1 month ago | |
| spatie/laravel-sitemap | Generate XML sitemaps for Laravel automatically by crawling your site or building them manually. Add URLs, models, lastmod/changefreq/priority, images and alternates, then write to file or disk. Supports sitemap index and large sites. | 2,588 | 2,615 | 296 | 570K | 0 | 51.7 | 38.1 | MIT | 4 weeks ago | |
| spatie/mixed-content-scanner | Scan a website for mixed content by crawling pages and flagging insecure http:// resources in common HTML tags (img, script, iframe, link, etc.). Use MixedContentScanner with a logger to report where mixed content is found or missing. | 104 | 105 | 18 | 1K | 0 | 30.1 | 16.8 | MIT | 2 years ago | |
| spatie/mixed-content-scanner-cli | CLI tool to detect mixed content on HTTPS sites. Crawls pages and reports HTML elements whose URLs use http:// (images, scripts, iframes, forms, etc.). Install via Composer globally and run: mixed-content-scanner scan . | 91 | 91 | 20 | 0 | 0 | 23.8 | — | MIT | 3 years ago | |
| spatie/one-package-to-rule-them-all | Pulls in all Spatie packages at once so you don’t have to require them individually. Install via Composer, optionally publish the config, and get the full Spatie “magic” in one go for your Laravel app. | 60 | 60 | 6 | 0 | 0 | 20.8 | — | MIT | 5 years ago |
Weaver
How can I help you explore Laravel packages today?