SentencePiece
Unsupervised text tokenizer for Neural Network-based text generation.
https://github.com/google/sentencepiece
Available modules
The overview below shows which SentencePiece installations are available per target architecture in the HPCC module system, ordered based on software version (new to old).
To start using SentencePiece, load one of these modules using a module load command like:
module load SentencePiece/0.2.0-GCC-12.3.0
(This data was automatically generated on Thu, 22 Jan 2026 at 12:03:27 EST)
| gateway | generic | zen2 | zen3 | zen4 | skylake_avx512 | |
|---|---|---|---|---|---|---|
| Gateway nodes | everywhere (except Grace nodes) | amd20 | amd22 | amd24 | intel18,amd20-v100,amd21,intel21 | |
| SentencePiece/0.2.0-GCC-12.3.0 | - | x | - | - | - | - |