Log in Register

Code Weaver

Helps Laravel developers discover, compare, and choose open-source packages. See popularity, security, maintainers, and scores at a glance to make better decisions.

Darvin Crawler Bundle Laravel Package

darvinstudio/darvin-crawler-bundle

View on GitHub

Deep Wiki

Context7

DarvinCrawlerBundle

This bundle provides console command that detects broken links on your website.

Sample configuration

# config/packages/dev/darvin_crawler.yaml
darvin_crawler:
    default_uri: https://example.com # Default value of command's "uri" argument
    blacklists:
        parse: # Content from URIs matching these regexes will not be parsed
            - '/\/filtered\//'
        visit: # URIs matching these regexes will not be visited
            - '/\/filtered\//'

Usage

Crawl default URI:

$ bin/console darvin:crawler:crawl

Crawl specified URI:

$ bin/console darvin:crawler:crawl https://example.com

Display all visited links:

$ bin/console darvin:crawler:crawl https://example.com -v

Weaver

How can I help you explore Laravel packages today?

Conversation history is not saved when not logged in.

Add packages to context

No packages found.

codraw/entity-migrator

codraw/doctrine-extra

codraw/aws-tool-kit

codraw/validator

codraw/workflow

codraw/open-api

codraw/cron-job

codraw/process

codraw/log

nexmo/api-specification

capell-app/block-library

axium/identity

cetria/laravel-dummy-models

cetria/reflection-helper

agropredict/sso-auth-bundle

evolvestudio/spam-protection

datacore/hub-sdk

develia/commons

cuci/prototurk-sdk

cuci/prototurk-sdk-symfony