GitHub 路 Rust
huggingface/tokenizers
馃挜 Fast State-of-the-Art Tokenizers optimized for Research and Production
- Stars
- 11,276
- Forks
- 1,277
- Stars gained in 24 hours
- +11
- Forks gained in 24 hours
- +7
Topics: bert, gpt, language-model, natural-language-processing, natural-language-understanding, nlp, transformers
Latest data point: Nov 22, 2026 路 11,276 stars 路 1,277 forks