Home > Repository > base > python-tokenizers
An implementation of today's most used tokenizers, with a focus on performance and versatility.
python-tokenizers: An implementation of today's most used tokenizers, with a focus on performance and versatility
An implementation of today's most used tokenizers, with a focus on performance and versatility.
| Nome: | python-tokenizers |
| Versione: | 0.22.2-1mamba |
| Gruppo: | System/Libraries |
| Manutentore: | silvan |
| Licenza: | Apache License 2.0 |
| Dimensione: | 373.66 kB |
| URL di origine: | https://github.com/huggingface/tokenizers |
| Data di compilazione: | 2026-01-20 18:07:19 |
Pacchetti binari e dipendenze
| x86_64 | |
|---|---|
| RPM creati | python-tokenizers-debug python-tokenizers-py3 |
| Dipendenze di compilazione | glibc-devel [1] libgcc [1] libpython3-devel [1] libpython311-devel [1] libstdc++6-devel [1] python3 [1] python3.11dist(huggingface-hub) [1] |
Cronologia delle modifiche
| Data | Packager | Versione | Descrizione |
|---|---|---|---|
| 2026-01-20 | silvan | 0.22.2-1mamba | - package created using the webbuild interface |
