Weave Code
Robots Txt Laravel Package
spatie/robots-txt
Generate and serve a correct robots.txt in Laravel with an expressive API. Add user-agents, allow/disallow rules, sitemaps and host directives, then publish it via a route or controller—perfect for managing crawler access per environment.
|
Package
|
Description
|
Stars
|
Likes
|
Forks
|
Downloads
|
Issues
|
Score
|
Opportunity
|
License
|
Last Release
|
|
|---|---|---|---|---|---|---|---|---|---|---|---|
| atoolo/crawler-teaser-indexer | — | 0 | 0 | 0 | 7 | 0 | 17.6 | 14.4 | MIT | 1 month ago | |
| spatie/crawler | PHP web crawler that discovers links concurrently via Guzzle, with optional JavaScript rendering powered by Chrome/Puppeteer. Configure depth, internal-only rules, and callbacks for per-page handling, plus a fake mode to test crawl logic without real HTTP requests. | 2,821 | 2,829 | 367 | 649K | 0 | 55.7 | 38.3 | MIT | 2 weeks ago | |
| spatie/one-package-to-rule-them-all | Pulls in all Spatie packages at once so you don’t have to require them individually. Install via Composer, optionally publish the config, and get the full Spatie “magic” in one go for your Laravel app. | 60 | 60 | 6 | 0 | 0 | 0.8 | — | MIT | 5 years ago |
Weaver
How can I help you explore Laravel packages today?