vdb/php-spider
A configurable PHP web spider/crawler with a modular architecture for scraping and traversing sites. Define start URLs, URI filters, processors, and post-processors to control crawl depth, skip duplicate pages, and extract or analyze content with custom callbacks.
|
Package
|
Score
|
Description
|
Stars
|
Likes
|
Forks
|
Downloads
|
Issues
|
Score
|
Opportunity
|
License
|
Last Release
|
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| jaeger/querylist | 0.86 | QueryList is a PHP web scraping and crawling library with a jQuery-like syntax for querying HTML/XML. It offers a powerful HTTP client, plugin system, and seamless Laravel integration, letting you extract data from pages with concise, familiar selectors. | 2,690 | 2,753 | 423 | 5K | 4 | 32.1 | 7.6 | — | 9 months ago | |
| darvinstudio/darvin-crawler-bundle | 0.84 | — | 0 | 0 | 0 | 79 | 0 | 1.5 | 26.3 | MIT | 5 years ago | |
| jaybizzle/laravel-crawler-detect | 0.84 | Laravel middleware and service provider for detecting bots, crawlers, and spiders via jaybizzle/crawler-detect. Identify requests as crawlers, block them, or route them differently in your app. | 325 | — | 28 | — | 0 | 17.2 | — | MIT | 3 months ago |
|
| mediamonks/crawler | 0.84 | A Laravel/PHP package for crawling websites: follow links, extract page content, and run custom handlers per URL. Useful for scraping, link checking, sitemap generation, and content audits, with configurable crawl limits and Laravel-friendly integration. | 21 | 21 | 4 | 5 | 0 | 0.2 | 1.2 | MIT | — | |
| ziming/laravel-scrapingbee | 0.84 | A Laravel wrapper for the ScrapingBee API that makes web scraping simple. Configure your API key, then fetch pages with JavaScript rendering, premium proxies, screenshots, extraction rules, and custom headers through a clean, expressive client for Laravel apps with easy configuration. | 43 | — | 8 | — | 0 | 18.7 | — | MIT | 1 month ago | |
| cdaguerre/robots-bundle | 0.84 | — | 0 | 0 | 1 | 0 | 0 | 2.1 | — | — | 9 years ago | |
| manticoresoftware/manticoresearch-php | 0.84 | Official PHP client for Manticore Search with a fluent query builder, bulk indexing, and support for HTTP and SQL-style APIs. Easily integrates with Laravel or plain PHP apps to add fast full-text search. | 209 | — | 38 | — | 12 | 5.7 | 4.1 | MIT | 1 year ago |
|
| roach-php/core | 0.84 | Roach is a complete web scraping toolkit for PHP inspired by Scrapy. Define spiders that crawl pages, extract data with CSS or XPath selectors, follow links, and export structured results, with built-in queueing, throttling, and extensible middleware. | 1,456 | 1,456 | 91 | 19K | 18 | 16.8 | 27.0 | — | 1 year ago | |
| gidlov/copycat | 0.84 | Copycat is a Laravel package for crawling websites and consuming APIs. Define reusable "places" with methods that fetch and parse remote content, then call them like local models — a clean, ORM-style way to scrape HTML or JSON without repetitive HTTP and parsing code. | 71 | 78 | 13 | 0 | 0 | 1.0 | — | LGPL-3.0 | 9 years ago | |
| electrolinux/phpquery | 0.83 | phpQuery is a server-side, jQuery-like PHP library for parsing and manipulating HTML/XML DOM. It provides CSS3 selectors, chainable traversal and manipulation methods, and a familiar API for scraping, templating, and document processing. | 164 | 199 | 63 | 74K | 0 | 2.8 | 36.7 | — | — | |
| firecrawl/firecrawl-sdk | 0.83 | Official Firecrawl SDK for PHP and Laravel. Scrape web pages into clean markdown or structured data, crawl entire sites, search the web, and run extraction jobs through a simple client wrapper around the Firecrawl API. Handy for RAG pipelines, AI agents, and content ingestion. | 2 | 2 | 2 | 20K | 0 | 0.1 | 52.7 | — | — | |
| fisharebest/algorithm | 0.83 | A small PHP library of reusable algorithm implementations, including Dijkstra shortest-path and topological sorting, for graph traversal, dependency ordering, and routing tasks in Laravel or any Composer-based PHP project. | 71 | — | 23 | — | 3 | 2.0 | 1.1 | GPL-3.0 | — |
|
| revolution/salvager | 0.83 | Revolution Salvager is a Laravel package for salvaging recoverable data from failed or interrupted operations, helping you capture what would otherwise be lost and restore it cleanly. Lightweight, configurable, and built to fit existing Laravel workflows. | 7 | 7 | 3 | 384 | 0 | 0.1 | 23.4 | MIT | — | |
| pisotskyi-el/evomi-scraper | 0.83 | A Laravel wrapper for the Evomi proxy service that simplifies web scraping. Configure residential or datacenter proxies, route requests through Evomi, and handle responses with a clean, fluent API. Ideal for collecting data reliably while avoiding blocks and rate limits. | 0 | 0 | — | 303 | — | 0.0 | 34.3 | — | — | |
| codeguy/arachnid | 0.83 | Arachnid is a lightweight PHP web crawler and scraper with a simple, expressive API for fetching pages, following links, and extracting content. Use it to automate site navigation and data collection in Laravel or any PHP app, and chain requests and selectors to build custom spiders quickly. | 254 | — | 59 | — | 5 | 4.4 | 1.1 | MIT | 5 years ago |
|
| vlados/laravel-blade-crawler-detect | 0.83 | Detect search engine crawlers and bots directly in your Blade templates. Simple directives let you serve crawler-specific markup, hide dynamic content, or tailor SEO output without touching controllers—keeping views clean and detection logic reusable across any Laravel app. | 0 | 0 | 0 | 160 | 0 | 9.7 | 33.4 | MIT | 6 months ago | |
| jaeger/phpquery-single | 0.83 | phpQuery-single is a single-file PHP port of jQuery's DOM API, letting you parse, query, and manipulate HTML/XML using familiar CSS selectors and chainable methods. No extensions or extra dependencies required—just drop it in and go. | 140 | 144 | 91 | 4K | 4 | 4.5 | 21.9 | — | — | |
| nelexa/roach-php-bundle | 0.83 | Symfony bundle that integrates Roach PHP, the complete web scraping toolkit, into your app with dependency injection configuration, ready-to-use crawler services, and console commands for running spiders and scrapers. | 10 | 10 | 3 | 19 | 0 | 19.8 | 7.1 | MIT | 1 week ago | |
| lbonnet/on-page-seo-bundle | 0.83 | lbonnet/on-page-seo-bundle centralizes on-page SEO metadata for Symfony applications. Configure page titles, meta descriptions, canonical URLs, robots directives, and Open Graph/Twitter tags from a single service for consistent, maintainable SEO. | 0 | 0 | 0 | 0 | 0 | 8.8 | — | MIT | 1 month ago | |
| duzun/hquery | 0.83 | hQuery is a fast, lightweight PHP HTML/XML parser with a jQuery-like API. It supports CSS selectors and DOM traversal, has no external dependencies, and handles broken or incomplete HTML gracefully, making web scraping, content extraction, and HTML manipulation simple and memory-efficient. | 359 | 361 | 69 | 19K | 15 | 8.8 | 30.6 | MIT | — |
How can I help you explore Laravel packages today?