yethee/tiktoken
This PHP port of OpenAI's tiktoken lets you encode text into tokens for models like gpt-3.5-turbo and any BPE encoding such as p50k_base. Includes vocabulary caching by default and an experimental FFI lib mode for faster encoding of larger texts.
|
Person
|
Packages
|
Contributions
|
Followers
|
|
|---|---|---|---|---|
|
Deni
@yethee |
50 | 1,103 | 26 |
View on GitHub
|
|
Arsen Ibragimov
@iamarsenibragimov |
5 | 6 | 9 |
View on GitHub
|
|
Matt Clinton
@clnt |
9 | 40 | 16 |
View on GitHub
|
|
snapshotpl
@snapshotpl |
96 | 841 | 126 |
View on GitHub
|
|
Miquel de la Fuente
@KumaVolt |
1 | 1 | 8 |
View on GitHub
|
How can I help you explore Laravel packages today?