Home > Repositories > devel-misc > python-tokenizers > python-tokenizers (x86_64)
Resources:
Source files | Changes
Issues | Add a new issue
Download

python-tokenizers: An implementation of today's most used tokenizers, with a focus on performance and versatility

An implementation of today's most used tokenizers, with a focus on performance and versatility.
⚠ This package has the following problems:
  • python-tokenizers(x86_64,devel-misc) obsoletes python-tokenizers-py3 provided by python-tokenizers-py3(x86_64,base) which comes from same source name; ignoring
  • aider-chat(noarch,base) requires python3.11dist(tokenizers) which is only provided by older package(s): python-tokenizers-py3(x86_64,base)
  • python-litellm-py3(noarch,base) requires python3.11dist(tokenizers) which is only provided by older package(s): python-tokenizers-py3(x86_64,base)
Name:python-tokenizers
Release: 0.23.1-2mamba
Architecture:x86_64
Group:System/Libraries
Size:2.67 MB
Upstream URL:https://github.com/huggingface/tokenizers
Source RPM:python-tokenizers
BrothersProvidesObsoletesRequiresRecommends
python-tokenizers-debug
python-tokenizers = 0:0.23.1-2mamba
python-tokenizers(x86-64) = 0:0.23.1-2mamba
python-tokenizers-py3 = 0:0.23.1-2mamba
python3.14dist(tokenizers) = 0:0.23.1
python3dist(tokenizers) = 0:0.23.1
python-tokenizers-py3 < 0:0.23.1-2mamba
ld-linux-x86-64.so.2()(64bit) [1]
ld-linux-x86-64.so.2(GLIBC_2.3)(64bit) [1]
libc.so.6(GLIBC_2.34)(64bit) [1]
libgcc_s.so.1()(64bit) [1] [2]
libgcc_s.so.1(GCC_3.0)(64bit) [1] [2]
libgcc_s.so.1(GCC_3.3)(64bit) [1] [2]
libgcc_s.so.1(GCC_4.2.0)(64bit) [1] [2]
libm.so.6()(64bit) [1]
libm.so.6(GLIBC_2.29)(64bit) [1]
libstdc++.so.6()(64bit) [1]
libstdc++.so.6(CXXABI_1.3)(64bit) [1]
libstdc++.so.6(CXXABI_1.3.8)(64bit) [1]
libstdc++.so.6(GLIBCXX_3.4)(64bit) [1]
python(abi) = 0:3.14 [1] [2] [3] [4]
python3.14dist(huggingface-hub) < 2~~ [1]
python3.14dist(huggingface-hub) >= 0.16.4) [1]
rtld(GNU_HASH) [1]
Required by Build required by Provided files