Weave Code
Weaver
Helps Laravel developers discover, compare, and choose open-source packages. See popularity, security, maintainers, and scores at a glance to make better decisions.
Feedback
Share your thoughts, report bugs, or suggest improvements.
Subject
Message
Log in Register
Home
Packages
Crawlify

Crawlify Laravel Package

dezento/crawlify

dezento/crawlify is a Laravel package that brings web crawling into your application with a simple, configurable API. Use it to crawl sites, process responses, and power SEO checks, site audits, and content discovery workflows without leaving PHP.

View on GitHub
Deep Wiki
Context7

dezento/crawlify is a Laravel package for web crawling — it lets you traverse a site, follow links, and collect pages or data using Laravel's familiar conventions. Configure crawl targets and limits, then run crawls through queued jobs so large sites don't block your application.

  • Configurable crawl depth and URL limits
  • Link extraction and traversal across pages
  • Queue-ready jobs for background crawling
  • Laravel-native configuration and integration

Ideal for sitemap generation, link auditing, or scraping structured content within a Laravel app.

Weaver

How can I help you explore Laravel packages today?

Conversation history is not saved when not logged in.
Prompt
Add packages to context
No packages found.
robertmarney/lara-hierarchial-collections
simonschaufi/rule-doc-generator
emissaoja/emissaoja
blackbricksoftware/gravityforms-civicrm-form-processor
al-rahabi/fancy-crud
jinas/dhivatar-component
mltstephane/laravel-quality
bernskiold/laravel-talentlms
bernskioldmedia/laravel-form-architect
youbar/easy-crud
c-point-labs/laravel-hostyourai
dbravoan/dbcms-admin-theme-dbcms
dbravoan/dbcms-theme-db-cyber
dbravoan/dbcms-blocks-basic
dbravoan/dbcms-module-content-audit
dbravoan/dbcms-module-ai-assistant
paygate-to/paygate-php
padosoft/askmydocs-connector-base
defstudio/supercharged-carbon
bernskioldmedia/laravel-matomo