spatie/robots-txt
Spatie's robots-txt package checks whether a page may be indexed or followed using robots.txt rules, robots meta tags, and HTTP headers. It supports custom user agents, custom robots.txt locations, disallow reasons, and crawl delays.
None
|
Package
|
Constraint
|
|---|---|
| phpunit/phpunit | ^11.5.2 |
How can I help you explore Laravel packages today?