[ 源代码: sentencepiece ]
软件包:sentencepiece(0.2.0-1 以及其他的)
Unsupervised text tokenizer and detokenizer
SentencePiece is an unsupervised text tokenizer/detokenizer mainly designed for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.
其他与 sentencepiece 有关的软件包
|
|
|
|
-
- dep: libc6 (>= 2.38)
- GNU C 语言运行库:共享库
同时作为一个虚包由这些包填实: libc6-udeb
-
- dep: libgcc-s1 (>= 3.0)
- GCC 支持库
-
- dep: libsentencepiece0 (>= 0.2.0)
- Library files of SentencePiece
-
- dep: libstdc++6 (>= 13.1)
- GNU 标准 C++ 库,第3版