spatie/crawler
PHP web crawler that discovers links concurrently via Guzzle, with optional JavaScript rendering powered by Chrome/Puppeteer. Configure depth, internal-only rules, and callbacks for per-page handling, plus a fake mode to test crawl logic without real HTTP requests.
|
Package
|
Constraint
|
|---|---|
| guzzlehttp/guzzle | ^7.3 |
| guzzlehttp/psr7 | ^2.0 |
| spatie/robots-txt | ^2.0 |
| symfony/css-selector | ^7.0|^8.0 |
| symfony/dom-crawler | ^7.0|^8.0 |
|
Package
|
Constraint
|
|---|---|
| pestphp/pest | ^4.0 |
| phpstan/extension-installer | ^1.4 |
| phpstan/phpstan | ^2.0 |
| phpstan/phpstan-deprecation-rules | ^2.0 |
| phpstan/phpstan-phpunit | ^2.0 |
| spatie/invade | ^2.1 |
| spatie/ray | ^1.37 |
How can I help you explore Laravel packages today?