Code Weaver

Helps Laravel developers discover, compare, and choose open-source packages. See popularity, security, maintainers, and scores at a glance to make better decisions.

Robots Txt File Laravel Package

webignition/robots-txt-file

Parse and work with robots.txt files: convert raw content into a model, query directives per user-agent, check if a path is allowed, extract sitemap URLs, filter directives by type, and generate robots.txt strings programmatically.

View on GitHub

Deep Wiki

Context7

3.0

support PHP 7.2+ only (#20)
compatibility with webignition/disallowed-character-terminated-string 2.0
improve robustness (PSR-12 #21, phpstan static analysis #22)

2.1.1

2.1

2.0

move functionality from webignition/robots-txt-parser into this package
add Inspector class for inspecting a File model
add support for checking if a given user agent is allowed to access a given URL path
lots of internal refactoring
not compatible with 1.x

0.3

Weaver

How can I help you explore Laravel packages today?

Conversation history is not saved when not logged in.

Add packages to context

No packages found.

besmartand-pro/php-quality-config

sentix/ai-chatbot

terminal42/code-quality-tools

codifyo/ts-generator-bundle

testo/fiber

mintobit/jobqueue

a4sex/maintenance-bundle

a4sex/entity-date-update

a4sex/client-identifier

a4sex/base-utilites

a4sex/key-value-storage

a4sex/micro-status

chilldev/dependency-injection-extra

datinglibre/datinglibre-app-api

biberltd/corebundle

bricre/symfony-bundle-test

biberltd/logbundle

dominium/http-adapter-bundle

dominium/google-analytics

a4sex/auto-clean-entity