Home > Repository > devel-autodist > python-tokenizers
An implementation of today's most used tokenizers, with a focus on performance and versatility.
tokenizers-0.23.1.tar.gz
Richiesto in compilazione da
python-tokenizers: An implementation of today's most used tokenizers, with a focus on performance and versatility
An implementation of today's most used tokenizers, with a focus on performance and versatility.
⚠ Questo pacchetto ha i seguenti problemi:
- python-tokenizers-py3(x86_64,devel-autodist): python3.11dist(tokenizers)=0:0.23.1 from python-tokenizers-py3(x86_64,devel-autodist) fails to provide python3.11dist(tokenizers)=0:0.22.2 to python-litellm-py3(noarch,devel-autodist)
- da ricompilare: python-litellm(x86_64,devel-autodist)
| Nome: | python-tokenizers |
| Versione: | 0.23.1-1mamba |
| Gruppo: | System/Libraries |
| Manutentore: | silvan |
| Licenza: | Apache License 2.0 |
| Dimensione: | 367.93 kB |
| URL di origine: | https://github.com/huggingface/tokenizers |
| Data di compilazione: | 2026-04-27 20:40:26 |
File sorgenti
python-tokenizers.spectokenizers-0.23.1.tar.gz
Pacchetti binari e dipendenze
| x86_64 | |
|---|---|
| RPM creati | python-tokenizers-debug python-tokenizers-py3 |
| Dipendenze di compilazione | glibc-devel [1] libgcc [1] libpython3-devel [1] libpython311-devel [1] libstdc++6-devel [1] python3 [1] python3.11dist(huggingface-hub)[<2~~] [1] python3.11dist(huggingface-hub)[>=0.16.4)] [1] |
Cronologia delle modifiche
| Data | Packager | Versione | Descrizione |
|---|---|---|---|
| 2026-04-27 | Automatic Build System | 0.23.1-1mamba | - automatic version update by autodist |
| 2026-01-20 | silvan | 0.22.2-1mamba | - package created using the webbuild interface |
