Weave Code
Weaver
Helps Laravel developers discover, compare, and choose open-source packages. See popularity, security, maintainers, and scores at a glance to make better decisions.
Feedback
Share your thoughts, report bugs, or suggest improvements.
Subject
Message
Log in Register
Home
Packages
Robots Txt File
Release Notes

Robots Txt File Laravel Package

webignition/robots-txt-file

Parse and work with robots.txt files: convert raw content into a model, query directives per user-agent, check if a path is allowed, extract sitemap URLs, filter directives by type, and generate robots.txt strings programmatically.

View on GitHub
Deep Wiki
Context7
3.0
  • support PHP 7.2+ only (#20)
  • compatibility with webignition/disallowed-character-terminated-string 2.0
  • improve robustness (PSR-12 #21, phpstan static analysis #22)
2.1.1
2.1
2.0
  • move functionality from webignition/robots-txt-parser into this package
  • add Inspector class for inspecting a File model
  • add support for checking if a given user agent is allowed to access a given URL path
  • lots of internal refactoring
  • not compatible with 1.x
0.3
Weaver

How can I help you explore Laravel packages today?

Conversation history is not saved when not logged in.
Prompt
Add packages to context
No packages found.
andydefer/laravel-notification
adachsoft/cli-process-tester
jhaskell13/laraflow
sebastienheyd/boilerplate-media-manager
ccast/tagixo-primix
pretendtrue/laravel-builder
sawmainek/laravel-scout-tntsearch-driver
tomshaw/laravel-calendar-table
dibakar/laravel-ownership
steadrun/laravel-monitor
labyrinthe/connect-laravel
elmogy/layan
drewdan/sentinel-client
dskripchenko/laravel-llm
fatryst/nuonuo
stevenay/myanfont
gmostafa/php-graphql-client
xeviant/paystack
snowsoft/faker
meditationsteps/blogetc