Crawler Laravel Package
spatie/crawler
PHP web crawler with concurrent requests via Guzzle. Crawl internal/external links, limit depth, and collect discovered URLs. Supports JavaScript-rendered sites using Chrome/Puppeteer. Includes faking responses for testing crawl logic without real HTTP calls.
|
Person
|
Packages
|
Contributions
|
Followers
|
|
|---|---|---|---|---|
freekmurze
@freekmurze |
402 | 38,990 | 5,208 |
View on GitHub
|
Carlos Monroy
@Redominus |
5 | 21 | 3 |
View on GitHub
|
Adriaan Marain
@AdrianMrn |
257 | 1,848 | 237 |
View on GitHub
|
Denver
@denvers |
1 | 9 | 18 |
View on GitHub
|
Mattias Geniar
@mattiasgeniar |
21 | 292 | 821 |
View on GitHub
|
BenMorel
@BenMorel |
55 | 3,451 | 234 |
View on GitHub
|
rubenvanassche
@rubenvanassche |
99 | 5,146 | 308 |
View on GitHub
|
AlexVanderbist
@AlexVanderbist |
300 | 3,021 | 536 |
View on GitHub
|
sebastiandedeyne
@sebastiandedeyne |
176 | 2,497 | 1,031 |
View on GitHub
|
pascalbaljet
@pascalbaljet |
54 | 934 | 586 |
View on GitHub
|
Peter Thaleikis
@spekulatius |
33 | 40 | 736 |
View on GitHub
|
David Racovan
@superpenguin612 |
1 | 3 | 44 |
View on GitHub
|
localheinz
@localheinz |
316 | 13,270 | 655 |
View on GitHub
|
Peter Tihanyi
@systream |
1 | 3 | 19 |
View on GitHub
|
Andrzej Kupczyk
@andrzejkupczyk |
10 | 13 | 18 |
View on GitHub
|
Thomas Verhelst
@TVke |
8 | 35 | 37 |
View on GitHub
|
Jürgen
@juukie |
33 | 85 | 48 |
View on GitHub
|
Brent Robert
@BrentRobert |
4 | 13 | 10 |
View on GitHub
|
Avtandil Kikabidze
@akalongman |
16 | 82 | 250 |
View on GitHub
|
Mansoor Ahmed
@mansoorkhan96 |
31 | 215 | 22 |
View on GitHub
|
jimirobaer
@jimirobaer |
72 | 179 | 18 |
View on GitHub
|
Philippe Villiers
@kissifrot |
8 | 15 | 11 |
View on GitHub
|
Baryshnikov Roman
@barocode |
1 | 2 | 0 |
View on GitHub
|
A. Koepcke
@akoepcke |
88 | 141 | 15 |
View on GitHub
|
Emre Çalışkan
@thecaliskan |
83 | 141 | 17 |
View on GitHub
|
Vincent Moulene
@vincentmoulene |
3 | 3 | 18 |
View on GitHub
|
Robbert
@RobLui |
11 | 11 | 12 |
View on GitHub
|
Richard van Baarsen
@riesjart |
16 | 40 | 14 |
View on GitHub
|
pgrimaud
@pgrimaud |
63 | 63 | 628 |
View on GitHub
|
Pierre Arnissolle
@arnissolle |
3 | 3 | 23 |
View on GitHub
|
Peter Steenbergen
@petericebear |
3 | 7 | 52 |
View on GitHub
|
Pavel
@DvDty |
7 | 13 | 26 |
View on GitHub
|
patinthehat
@patinthehat |
135 | 1,316 | 134 |
View on GitHub
|
Adam Tomat
@adamtomat |
2 | 2 | 19 |
View on GitHub
|
Cédric T.
@cth-latest |
3 | 5 | 12 |
View on GitHub
|
VincentLanglet
@VincentLanglet |
262 | 3,931 | 107 |
View on GitHub
|
Voltra
@Voltra |
10 | 204 | 16 |
View on GitHub
|
Rias
@riasvdv |
150 | 1,453 | 391 |
View on GitHub
|
Alexey Shokov
@alexeyshockov |
27 | 285 | 94 |
View on GitHub
|
Antonis Flangofas
@flangofas |
2 | 4 | 29 |
View on GitHub
|
Björn Hasse
@bjoernhasse |
1 | 1 | 9 |
View on GitHub
|
scrlkx
@scrlkx |
3 | 3 | 33 |
View on GitHub
|
Frank Kemps
@Bapawe |
4 | 4 | 1 |
View on GitHub
|
G. Caruso
@carusogabriel |
410 | 1,440 | 526 |
View on GitHub
|
Kyle
@kmcluckie |
1 | 1 | 2 |
View on GitHub
|
M Asef
@asefsoft |
4 | 4 | 3 |
View on GitHub
|
M. Vugteveen
@it-can |
45 | 131 | 41 |
View on GitHub
|
Niels Vanpachtenbeke
@Nielsvanpach |
177 | 1,939 | 85 |
View on GitHub
|
Robbin Benard
@robbinbenard |
1 | 1 | 4 |
View on GitHub
|
Robin
@robinmiau |
1 | 1 | 6 |
View on GitHub
|
Tiago Oliveira de Farias
@tofarias |
1 | 1 | 21 |
View on GitHub
|
Julius Kiekbusch
@Jubeki |
98 | 338 | 88 |
View on GitHub
|
Dan P.
@mallardduck |
50 | 474 | 78 |
View on GitHub
|
Nils
@poldixd |
16 | 29 | 15 |
View on GitHub
|
angeljqv
@angeljqv |
39 | 73 | 1 |
View on GitHub
|
grafst
@grafst |
11 | 20 | 14 |
View on GitHub
|
hasansoyalan
@hasansoyalan |
1 | 1 | 1 |
View on GitHub
|
juLorenzo
@juLorenzo |
1 | 1 | 0 |
View on GitHub
|
| 3 | 3 | 5 |
View on GitHub
|
|
Mattia Basone
@mattiabasone |
5 | 7 | 22 |
View on GitHub
|
| 14 | 29 | 68 |
View on GitHub
|
|
BackEndTea
@BackEndTea |
108 | 367 | 143 |
View on GitHub
|
blueclock
@blueclock |
15 | 22 | 45 |
View on GitHub
|
Hélio
@insign |
5 | 6 | 0 |
View on GitHub
|
Ioannis
@ilazaridis |
2 | 3 | 11 |
View on GitHub
|
Jan Pedryc
@jpedryc |
1 | 1 | 13 |
View on GitHub
|
Joe Tito
@joe-tito |
1 | 1 | 0 |
View on GitHub
|
Jorrit van Vrouwerff
@SERFF |
1 | 1 | 3 |
View on GitHub
|
barryvdh
@barryvdh |
165 | 5,641 | 6,877 |
View on GitHub
|
Chin Leung
@chinleung |
7 | 196 | 51 |
View on GitHub
|
peter279k
@peter279k |
271 | 473 | 2,146 |
View on GitHub
|
Maarten Buis
@buismaarten |
19 | 41 | 2 |
View on GitHub
|
Michel Bardelmeijer
@mbardelmeijer |
39 | 83 | 37 |
View on GitHub
|
Michiel Kempen
@michielkempen |
6 | 13 | 11 |
View on GitHub
|
Nicolas
@NicolasMica |
2 | 3 | 2 |
View on GitHub
|
How can I help you explore Laravel packages today?