yethee/tiktoken
This PHP port of OpenAI's tiktoken lets you encode text into tokens for models like gpt-3.5-turbo and any BPE encoding such as p50k_base. Includes vocabulary caching by default and an experimental FFI lib mode for faster encoding of larger texts.
|
Package
|
Constraint
|
|---|---|
| symfony/service-contracts | ^2.5 || ^3.0 |
|
Package
|
Constraint
|
|---|---|
| doctrine/coding-standard | ^13 |
| mikey179/vfsstream | ^1.6.11 |
| phpbench/phpbench | ^1.2 |
| phpunit/phpunit | ^10.5.45 |
| psalm/plugin-phpunit | ^0.19.2 |
| vimeo/psalm | 6.15.1 |
How can I help you explore Laravel packages today?