Home > Repository > base > python-tokenizers

python-tokenizers: An implementation of today's most used tokenizers, with a focus on performance and versatility

An implementation of today's most used tokenizers, with a focus on performance and versatility.
Nome:python-tokenizers
Versione: 0.23.1-2mamba
Gruppo:System/Libraries
Manutentore:silvan
Licenza:Apache License 2.0
Dimensione:368.10 kB
URL di origine:https://github.com/huggingface/tokenizers
Data di compilazione:2026-07-08 16:25:24
File sorgenti
python-tokenizers.spec
tokenizers-0.23.1.tar.gz
Pacchetti binari e dipendenze
x86_64
RPM creatipython-tokenizers
python-tokenizers-debug
Dipendenze di compilazioneglibc-devel [1]
libgcc [1]
libpython314-devel [1]
libstdc++6-devel [1]
python3[>=0:3.14.6-2mamba] [1]
python3.14dist(huggingface-hub)[<2~~] [1]
python3.14dist(huggingface-hub)[>=0.16.4)] [1]
Cronologia delle modifiche
DataPackagerVersioneDescrizione
2026-07-08Automatic Build System 0.23.1-2mamba- rebuilt by autoport with build requirements: python3>=0:3.14.6-2mamba
2026-04-27Automatic Build System 0.23.1-1mamba- automatic version update by autodist
2026-01-20silvan0.22.2-1mamba- package created using the webbuild interface
Richiesto in compilazione da