[ 原始碼： sentencepiece ]
套件：sentencepiece（0.2.0-1 以及其他的）
Unsupervised text tokenizer and detokenizer
SentencePiece is an unsupervised text tokenizer/detokenizer mainly designed for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.
其他與 sentencepiece 有關的套件
|
|
|
|
-
- dep: libc6 (>= 2.38)
- GNU C 函式庫：共用函式庫
同時作為一個虛擬套件由這些套件填實： libc6-udeb
-
- dep: libgcc-s1 (>= 3.0)
- GCC 支援函式庫
-
- dep: libsentencepiece0 (>= 0.2.0)
- Library files of SentencePiece
-
- dep: libstdc++6 (>= 13.1)
- GNU Standard C++ Library v3