Weave Code
Crawler Laravel Package
spatie/crawler
PHP web crawler with concurrent requests via Guzzle. Crawl internal/external links, limit depth, and collect discovered URLs. Supports JavaScript-rendered sites using Chrome/Puppeteer. Includes faking responses for testing crawl logic without real HTTP calls.
Requirements
|
Package
|
Constraint
|
|---|---|
| guzzlehttp/guzzle | ^7.3 |
| guzzlehttp/psr7 | ^2.0 |
| spatie/robots-txt | ^2.0 |
| symfony/css-selector | ^7.0|^8.0 |
| symfony/dom-crawler | ^7.0|^8.0 |
Dev Requirements
|
Package
|
Constraint
|
|---|---|
| pestphp/pest | ^4.0 |
| phpstan/extension-installer | ^1.4 |
| phpstan/phpstan | ^2.0 |
| phpstan/phpstan-deprecation-rules | ^2.0 |
| phpstan/phpstan-phpunit | ^2.0 |
| spatie/invade | ^2.1 |
| spatie/ray | ^1.37 |
Weaver
How can I help you explore Laravel packages today?