darvinstudio/darvin-crawler-bundle
This bundle provides console command that detects broken links on your website.
# config/packages/dev/darvin_crawler.yaml
darvin_crawler:
default_uri: https://example.com # Default value of command's "uri" argument
blacklists:
parse: # Content from URIs matching these regexes will not be parsed
- '/\/filtered\//'
visit: # URIs matching these regexes will not be visited
- '/\/filtered\//'
Crawl default URI:
$ bin/console darvin:crawler:crawl
Crawl specified URI:
$ bin/console darvin:crawler:crawl https://example.com
Display all visited links:
$ bin/console darvin:crawler:crawl https://example.com -v
How can I help you explore Laravel packages today?