spatie/robots-txt
Generate and serve a correct robots.txt in Laravel with an expressive API. Add user-agents, allow/disallow rules, sitemaps and host directives, then publish it via a route or controller—perfect for managing crawler access per environment.
|
Package
|
Score
|
Description
|
Stars
|
Likes
|
Forks
|
Downloads
|
Issues
|
Score
|
Opportunity
|
License
|
Last Release
|
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| cdaguerre/robots-bundle | 0.85 | — | 0 | 0 | 1 | 0 | 0 | 2.1 | — | — | 8 years ago | |
| alibaba258/laravel-robots | 0.84 | Manage robots.txt dynamically in Laravel. Build rules per environment (e.g., allow production with sitemap, disallow non-prod), generate plain-text output, and optionally persist configuration via migration with a swappable data source. | 0 | 0 | 0 | 0 | 0 | 0.6 | — | MIT | 3 years ago | |
| spatie/laravel-robots-middleware | 0.84 | Laravel middleware to control search engine indexing via X-Robots-Tag/robots meta behavior. Extend the base middleware and implement shouldIndex() to allow or block indexing per request (e.g., disable for admin routes), without changing your views. | 0 | 336 | — | 52K | — | 21.2 | 34.1 | — | — | |
| mguinea/laravel-robots | 0.83 | — | 15 | 16 | 4 | 1K | 0 | 1.2 | 28.6 | MIT | — | |
| webignition/robots-txt-file | 0.82 | Parse and work with robots.txt files: convert raw content into a model, query directives per user-agent, check if a path is allowed, extract sitemap URLs, filter directives by type, and generate robots.txt strings programmatically. | 18 | 19 | 3 | 37K | 3 | 2.5 | 46.0 | MIT | 6 years ago | |
| anassrojea/laracrawler | 0.80 | — | 0 | 0 | 0 | 21 | 0 | 0.0 | 18.5 | MIT | — |
How can I help you explore Laravel packages today?