spatie/crawler
Fast, concurrent web crawler for PHP. Crawl sites, collect internal URLs with depth limits, and hook into crawl events. Can execute JavaScript via Chrome/Puppeteer for rendered pages. Includes fakes for testing crawl logic without real HTTP requests.
|
Package
|
Constraint
|
|---|---|
| guzzlehttp/guzzle | ^7.3 |
| guzzlehttp/psr7 | ^2.0 |
| spatie/robots-txt | ^2.0 |
| symfony/css-selector | ^7.0|^8.0 |
| symfony/dom-crawler | ^7.0|^8.0 |
|
Package
|
Constraint
|
|---|---|
| pestphp/pest | ^4.0 |
| phpstan/extension-installer | ^1.4 |
| phpstan/phpstan | ^2.0 |
| phpstan/phpstan-deprecation-rules | ^2.0 |
| phpstan/phpstan-phpunit | ^2.0 |
| spatie/invade | ^2.1 |
| spatie/ray | ^1.37 |
How can I help you explore Laravel packages today?