vipnytt/robotstxtparser
A PHP library for parsing robots.txt files, with support for user-agent groups, Allow/Disallow rules, wildcards, crawl-delay, and sitemap directives. Lightweight and framework-agnostic, it helps determine whether a crawler may access a given URL.
|
Package
|
Score
|
Description
|
Stars
|
Likes
|
Forks
|
Downloads
|
Issues
|
Score
|
Opportunity
|
License
|
Last Release
|
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sepia/po-parser | 0.85 | Sepia PO Parser is a PHP library for reading, writing, and updating GNU gettext .po translation files. It handles contexts, plural forms, comments, and multiline strings, making it useful for translation tools and programmatic localization workflows. | 126 | 128 | 57 | 48K | 3 | 3.2 | 36.6 | BSD-3-Clause | — | |
| evheniy/robots-txt-bundle | 0.84 | Symfony2 bundle that generates robots.txt from config.yml entries, including sitemap lines, and dumps it via app/console robots.txt:dump. Supports separate per-environment rules so dev can Disallow: / while prod lists a sitemap. | 5 | 5 | 1 | 12 | 0 | 0.4 | 6.6 | — | 11 years ago | |
| wxiangqian/laravel-dingtalk | 0.84 | A Laravel integration for DingTalk (钉钉) that wraps the DingTalk API in familiar Laravel style. Configure credentials, send robot or webhook messages, and add enterprise notifications through a simple, config-driven interface. Ideal for alerts, workflow updates, and team messaging. Easy Composer in... | 18 | 19 | 5 | 26 | 0 | 0.2 | 5.2 | — | — | |
| ua-parser/uap-php | 0.84 | UA Parser for PHP: parse browser user agents into structured data (browser, engine, OS, device) using the uap-core regex database. Helpful for analytics, logging, and device detection; easy integration via Composer and built-in caching support. | 562 | 575 | 85 | 888K | 3 | 6.4 | 45.5 | NOASSERTION | — | |
| yosymfony/parser-utils | 0.84 | A small PHP toolkit for building parsers, providing tokens, token streams, AST nodes, source locations, and syntax errors. It offers reusable utilities for lexers and recursive-descent parsers, and underpins libraries such as yosymfony/toml. | 21 | 21 | 3 | 48K | 0 | 0.2 | 46.1 | MIT | 8 years ago | |
| mehrab-wj/tiktoken-php | 0.84 | A PHP port of OpenAI's tiktoken tokenizer for fast, accurate BPE token counting. Supports GPT-4, GPT-3.5, and other model encodings, so you can count tokens and estimate API costs directly in Laravel or plain PHP without extra services. | 17 | — | 3 | — | 0 | 0.2 | — | MIT | 3 years ago |
|
| lbonnet/on-page-seo-bundle | 0.84 | lbonnet/on-page-seo-bundle centralizes on-page SEO metadata for Symfony applications. Configure page titles, meta descriptions, canonical URLs, robots directives, and Open Graph/Twitter tags from a single service for consistent, maintainable SEO. | 0 | 0 | 0 | 0 | 0 | 8.8 | — | MIT | 1 month ago | |
| the-3labs-team/laravel-ads-post-parser | 0.84 | A Laravel package for parsing advertising posts, extracting structured data from ad content so your application can normalize listings, import campaigns, and work with parsed ad fields more easily. | 1 | — | 0 | — | 0 | 20.0 | — | MIT | 2 weeks ago | |
| parsica-php/parsica | 0.84 | Parsica is a PHP parser combinator library for building custom parsers from small reusable pieces. Compose complex grammars with a fluent API, parse strings into structured results, and handle errors cleanly—ideal for DSLs, config formats, and language tooling. | 413 | 413 | 19 | 20K | 11 | 10.8 | 29.6 | MIT | 1 year ago | |
| miisieq/robots-txt-bundle | 0.84 | A Symfony bundle for generating and serving a dynamic robots.txt file, letting you define user-agent rules, disallow paths, and sitemap entries in configuration instead of a static file. Handy for multi-environment setups where crawl rules need to vary. | 3 | 3 | 1 | 0 | 0 | 0.0 | — | MIT | 8 years ago | |
| rodenastyle/stream-parser | 0.83 | Parse large CSV and other data files in PHP without exhausting memory. rodenastyle/stream-parser offers a simple, memory-efficient streaming API to read and process files chunk by chunk—ideal for Laravel imports, exports, and ETL jobs on big datasets. | 440 | — | 47 | — | 6 | 5.7 | 2.3 | MIT | 1 year ago | |
| vipnytt/useragentparser | 0.83 | A lightweight PHP library for parsing user agent strings, extracting browser, operating system, and device details. Integrates easily into Laravel projects for detecting client platforms, bots, and crawlers from incoming requests. | 1 | 2 | 1 | 14K | 0 | 0.0 | 53.2 | MIT | 1 year ago | |
| vtalbot/markdown | 0.83 | A Laravel package that integrates Markdown parsing into your app, with a Markdown facade and Blade directive for converting Markdown text to HTML. Useful for rendering user content, documentation, and other formatted text with configurable parser options. | 97 | — | 19 | — | 4 | 2.5 | 1.1 | — | 5 years ago | |
| anomaly/robots-extension | 0.83 | An extension for the Anomaly Streams platform that adds robots.txt management to your Laravel application, letting you control crawler directives and SEO indexing rules from the admin panel without editing files by hand. | 0 | 0 | 3 | 254 | 0 | 0.1 | 33.2 | MIT | — | |
| vipnytt/sitemapparser | 0.83 | A lightweight PHP library for parsing XML sitemaps and sitemap indexes. It recursively follows sitemap index files, extracts URLs, handles gzip compression, detects sitemap types, and supports robots.txt discovery with no external dependencies. | 78 | — | 33 | — | 0 | 8.2 | — | MIT | 3 months ago |
|
| yethee/tiktoken | 0.83 | This PHP port of OpenAI's tiktoken lets you encode text into tokens for models like gpt-3.5-turbo and any BPE encoding such as p50k_base. Includes vocabulary caching by default and an experimental FFI lib mode for faster encoding of larger texts. | 166 | 167 | 28 | 284K | 4 | 14.2 | 48.1 | MIT | 7 months ago | |
| php-standard-library/type | 0.83 | Runtime type validation for PHP built on the Parse, Don't Validate principle: coerce and assert unstructured input into well-typed data, with clear errors when values don't match. | 1 | 1 | 0 | 114K | 0 | 21.4 | 64.8 | MIT | 1 week ago | |
| laravie/parser | 0.83 | Laravie Parser is a PHP source-code parsing library for Laravel applications. It offers a simple API for tokenizing and traversing code, inspecting classes, methods, and syntax trees, and integrating static analysis or code-generation tools into your projects. | 230 | — | 27 | — | 0 | 2.1 | — | MIT | 1 year ago |
|
| r0073rr0r/skritphp | 0.83 | SkritPHP is a lightweight PHP package for writing, organizing, and running reusable scripts with a clean, expressive API. It integrates smoothly with Laravel and standalone PHP projects with minimal setup, helping you automate tasks, simplify workflows, and keep script logic maintainable. | 1 | — | 0 | — | 0 | 9.8 | — | GPL-3.0 | 6 months ago | |
| polidog/php-chatwork-api | 0.83 | A lightweight PHP client for the ChatWork API. Send messages, manage rooms, tasks, files, and contacts through a simple, fluent interface. Install with Composer, authenticate with your API token, and start calling ChatWork endpoints in minutes. | 28 | — | 9 | — | 0 | 0.4 | — | MIT | 3 years ago |
|
How can I help you explore Laravel packages today?