yethee/tiktoken
PHP port of OpenAI tiktoken for fast tokenization. Get encoders by model or encoding name, encode text to token IDs, with default vocab caching and configurable cache dir. Optional experimental FFI lib mode (tiktoken-rs) for better performance on larger texts.
|
Person
|
Packages
|
Contributions
|
Followers
|
|
|---|---|---|---|---|
|
Deni
@yethee |
8 | 119 | 26 |
View on GitHub
|
|
Arsen Ibragimov
@iamarsenibragimov |
1 | 2 | 9 |
View on GitHub
|
|
Matt Clinton
@clnt |
1 | 2 | 15 |
View on GitHub
|
|
Miquel de la Fuente
@KumaVolt |
1 | 1 | 6 |
View on GitHub
|
|
Witold Wasiczko
@snapshotpl |
49 | 377 | 119 |
View on GitHub
|
How can I help you explore Laravel packages today?