yethee/tiktoken
This PHP port of OpenAI's tiktoken lets you encode text into tokens for models like gpt-3.5-turbo and any BPE encoding such as p50k_base. Includes vocabulary caching by default and an experimental FFI lib mode for faster encoding of larger texts.
|
Package
|
Description
|
Stars
|
Likes
|
Forks
|
Downloads
|
Issues
|
Score
|
Opportunity
|
License
|
Last Release
|
|
|---|---|---|---|---|---|---|---|---|---|---|---|
| ahmednour/eloquent-rag | — | 0 | 0 | 0 | 0 | 0 | 18.2 | — | MIT | 1 month ago | |
| benbjurstrom/markdown-object | Intelligent Markdown chunking for LLM/RAG workflows. Preserves headings, lists, tables, and semantic relationships while splitting into token-aware chunks sized for embedding model context windows. Built on League CommonMark with TikToken support. | 22 | 23 | 1 | 3K | 1 | 3.2 | 28.7 | MIT | 11 months ago | |
| cognesy/instructor-utils | — | 0 | — | 0 | — | 0 | 20.0 | — | MIT | 4 days ago |
|
| droath/laravel-text-chunker | Flexible Laravel text chunking for AI/LLM apps. Split content into smaller chunks by characters, tokens, sentences, or markdown-aware rules. Fluent, strategy-based API ideal for fitting token limits, RAG pipelines, and custom domain splitting. | 3 | 3 | 1 | 106 | 0 | 0.0 | 19.9 | MIT | — | |
| mis3085/tiktoken-for-laravel | TikToken for Laravel brings OpenAI's tiktoken tokenizer to your app, letting you count, encode, and decode tokens for GPT models through a simple facade. Estimate API costs, trim prompts to fit context limits, and integrate token counts into validation, logging, or usage tracking. | 27 | — | 6 | — | 0 | 10.5 | — | MIT | 6 months ago | |
| phoenix1331/laravel-ai-headroom | Laravel AI Headroom gives Laravel apps a simple, configurable way to add AI features, manage prompts and providers, and keep token usage within safe limits. Integrates with Laravel's config, facades, and queues for reliable AI workflows. | 1 | 2 | 0 | 624 | 0 | 19.4 | 40.3 | MIT | 3 weeks ago | |
| rajentrivedi/tokenizer-x | Tokenizer X is a Laravel package for generating and managing secure, unique tokens in your application. Use it for API authentication, email verification, password resets, and similar flows, with configurable token length and expiry. | 91 | — | 9 | — | 0 | 1.6 | 1.5 | MIT | 2 years ago | |
| survos/meili-bundle | Symfony bundle that integrates Meilisearch into your application, simplifying index configuration, indexing Doctrine entities, and running fast full-text and faceted searches through autowired services and sensible defaults. | 0 | 0 | 0 | 64 | 0 | 0.3 | 25.0 | — | 1 year ago | |
| theodo-group/llphant | LLPhant is a PHP generative AI framework for building LLM-powered apps with OpenAI, Anthropic, Mistral, and Ollama. It provides chat, embeddings, vector stores, RAG, agents, and document loaders, with straightforward integration into Laravel and plain PHP projects. | 1,722 | — | 179 | — | 25 | 43.3 | 18.8 | MIT | 1 week ago |
How can I help you explore Laravel packages today?