Weave Code
Weaver
Helps Laravel developers discover, compare, and choose open-source packages. See popularity, security, maintainers, and scores at a glance to make better decisions.
Feedback
Share your thoughts, report bugs, or suggest improvements.
Subject
Message

Escargot Laravel Package

terminal42/escargot

A Symfony HttpClient-based crawler framework for PHP that can crawl any HTTP resource, not just websites. Jobs are tracked by ID and backed by a queue, so long crawls can pause and resume.

View on GitHub
Deep Wiki
Context7
2.0.0

Escargot 2.0 fixes transport exception handling and exposes redirect destinations to subscribers. A major release is required because of two compatibility changes:

  • ExceptionSubscriberInterface::onTransportException() now accepts ResponseInterface|null. Symfony can throw before returning a response, which previously caused a TypeError while handling the original exception. Existing subscriber implementations must update their signature and handle null.
  • DoctrineQueue now requires a nullable redirected_to column. Existing queue tables must be migrated before using 2.0. Custom persistent queues must also store and restore redirect information. CrawlUri::getRedirectedTo() exposes the final redirect destination while getUri() retains the original requested URI. Redirect information is available to subscribers and persisted even when further response processing is skipped. The HTML crawler now resolves relative links against the final destination.

What's Changed

Full Changelog: https://github.com/terminal42/escargot/compare/1.7.0...2.0.0

1.6.2

What's Changed

New Contributors

Full Changelog: https://github.com/terminal42/escargot/compare/1.6.1...1.6.2

1.6.0

What's Changed

  • PHP 8.1 only, modernized the code base
  • Doctrine DBAL 3 only
  • Dropped support for Symfony < 5.4
  • Implemented a new Escargot::withMaxDurationInSeconds() option

Also see https://github.com/terminal42/escargot/pull/34

Full Changelog: https://github.com/terminal42/escargot/compare/1.5.3...1.6.0

1.5.3

What's Changed

Full Changelog: https://github.com/terminal42/escargot/compare/1.5.2...1.5.3

1.5.2
1.5.1

What's Changed

New Contributors

Full Changelog: https://github.com/terminal42/escargot/compare/1.5.0...1.5.1

1.5.0

What's Changed

  • Logo contribution 🎉
  • The DoctrineQueue has a new getTableSchema() method to fetch the required schema separate from createSchema().
  • Fixed query strings were not correctly checked in robots.txt evaluation.
1.4.0

What's Changed

  • Added support for Doctrine DBAL 3.x
  • Added support for Symfony 6 components
  • Added support for PHP 8.1

Full Changelog: https://github.com/terminal42/escargot/compare/1.3.0...1.4.0

1.1.0
  • Added support for data-escargot-ignore on links to exclude them completely from the HtmlCrawlerSubscriber
1.0.0

Escargot has been around for almost 1.5 years and was installed over 110k times. It deserves a version 1.0.0 tag now! 🎉

  • Added PHP 8 support
Weaver

How can I help you explore Laravel packages today?

Conversation history is not saved when not logged in.
Prompt
Add packages to context
No packages found.
htinlynn/genius-helper
maco-studios/hephaestus
elmogy/larafast
xeviant/laravel-paystack
gorilladash/laravel-website-sdk
martialbe/flysystem-oss
chondal/3312client
jeroen-g/flickr
opscale-co/nova-genbi
itsjustvita/laravel-retention
tequilarapido/trackit
gregsphotography/site-builder-filament
cabaoctavio/laravel-query-log
gregsphotography/site-builder-components
io-digital/clickatell
snowsoft/laravel-admin
oxygen/auth
relicsoftware/barakah-payment-gateway
tobya/work-with-composer
equipc/laravel-email-validator